DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Attention Is Not All You Need

Attention Is Not All You Need

1
Comments
5 min read
Building a $0 Modern Data Platform: dbt, MotherDuck, and Automated CI/CD (Zero AWS Required)

Building a $0 Modern Data Platform: dbt, MotherDuck, and Automated CI/CD (Zero AWS Required)

Comments
6 min read
Complexity-Aware TDD in Clojure: From O(n^2) to O(n log k)

Complexity-Aware TDD in Clojure: From O(n^2) to O(n log k)

Comments
10 min read
MySQL to Redshift Without DMS: A Binlog CDC Tutorial Through AWS Glue

MySQL to Redshift Without DMS: A Binlog CDC Tutorial Through AWS Glue

Comments
10 min read
Finding near-duplicate documents with MinHash and LSH before you index them for RAG

Finding near-duplicate documents with MinHash and LSH before you index them for RAG

Comments
4 min read
5 SQL traps that sink data engineering interviews (with runnable examples)

5 SQL traps that sink data engineering interviews (with runnable examples)

Comments
2 min read
Snowflake vs BigQuery vs Redshift vs Databricks: Start With How You're Billed

Snowflake vs BigQuery vs Redshift vs Databricks: Start With How You're Billed

Comments
3 min read
How Excel's 65K Row Limit Lost 16,000 COVID Tests

How Excel's 65K Row Limit Lost 16,000 COVID Tests

Comments
4 min read
Design a proximity service: the system design interview walkthrough

Design a proximity service: the system design interview walkthrough

Comments
17 min read
Design Reddit: the system design interview walkthrough

Design Reddit: the system design interview walkthrough

Comments
17 min read
Design a payment fraud detection system: the system design interview walkthrough

Design a payment fraud detection system: the system design interview walkthrough

Comments
18 min read
Design a distributed tracing system: the system design interview walkthrough

Design a distributed tracing system: the system design interview walkthrough

Comments
19 min read
Iceberg v3 Is Everywhere: What Data Engineers Must Know Now

Iceberg v3 Is Everywhere: What Data Engineers Must Know Now

Comments
9 min read
Control S3 Costs by Tracking Requests and Data Transfer

Control S3 Costs by Tracking Requests and Data Transfer

1
Comments
4 min read
Enriching 2,250 websites from their public pages: fetch 87%, email 73%, LinkedIn 54%

Enriching 2,250 websites from their public pages: fetch 87%, email 73%, LinkedIn 54%

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.