Home
Shameek Agarwal
Cancel

LLM

Exploring Top Models and Transformers “ollama” - helps us run cpp llm on our machine directly download from here - https://ollama.com/download/mac then, run this from your terminal - ollama...

Iceberg

Introduction rdbms are good for oltp workloads, not olap workloads involving aggregate queries on a large number of records components of an olap system - storage, file format, table format, ...

Observability

Introduction earlier, we had “monoliths”, so they had to be developed using “waterfall model” now “microservices” are developed using “ci cd”, so each module can be deployed and maintained in...

Airbyte

Overview why airbyte - do not have to reinvent the wheel to move data between multiple “sources” and “destinations” it gives a unified view of our integrations to help us debug issues, for mo...

React

React Introduction when writing react, we write functions called “components” these components return “jsx” which looks like html this jsx can contain either regular html elements or other ...

Airflow

Introduction we typically use apache airflow for organization - set the order of tasks, make sure the next task starts after the previous one is completed successfully and control the schedulin...

Kubernetes Advanced

Helm Getting Started docker desktop directly has an option to enable kubernetes. this starts a single node kubernetes cluster when the docker desktop app is started point kubectl to the righ...

DBT

DBT Introduction initial architecture was to load the transformed data into warehouses using etl the recent addition of cloud data warehouses led to promotion of elt - blast the data into the...

Spark Advanced

Stream Processing Motivation popular spark cloud platform - databricks popular spark on prem platform - cloudera setup for databricks and local is already covered here when our iterations...

Python Data Analysis

Jupyter Notebooks jupyter - web based environment for notebook documents allows to have python code along with headings, charts, tables, etc the entire flow - there is a notebook...