Skill category
Data Engineering, Warehousing & BI
The modern data stack: warehouses, lakehouses, transformation, orchestration and BI.
About this category
This category captures the tools used to move, model and serve data: cloud warehouses and lakehouses (Snowflake, Databricks, BigQuery, Redshift), transformation and orchestration (dbt, Airflow, Dagster), processing engines (Apache Spark, PySpark), table formats (Delta Lake, Apache Iceberg), integration patterns (ETL, ELT) and business intelligence tools (Power BI, Tableau, Looker).
Across the sample, 218 positions name at least one Data Engineering, Warehousing & BI skill, 17.2% of the 1,265 skill-tagged positions. Snowflake leads the category with 76 positions, ahead of Databricks (65) and dbt (55).
In the published analysis, the category's top-150 skills accounted for 599 skill mentions.
Skills in Data Engineering, Warehousing & BI
Positions naming each skill
| Skill | Positions | Share of all | Share of tagged | Rank |
|---|---|---|---|---|
| Snowflake | 76 | 1.9% | 6.0% | #19 |
| Databricks | 65 | 1.6% | 5.1% | #22 |
| dbt | 55 | 1.4% | 4.3% | #25 |
| ETL | 51 | 1.3% | 4.0% | #28 |
| Airflow | 47 | 1.2% | 3.7% | #31 |
| Apache Spark | 42 | 1.0% | 3.3% | #37 |
| BigQuery | 39 | 1.0% | 3.1% | #41 |
| Amazon Redshift | 27 | 0.7% | 2.1% | #63 |
| Power BI | 26 | 0.6% | 2.1% | #65 |
| Tableau | 21 | 0.5% | 1.7% | #78 |
| Data Modeling | 20 | 0.5% | 1.6% | #81 |
| PySpark | 20 | 0.5% | 1.6% | #82 |
| Delta Lake | 17 | 0.4% | 1.3% | #94 |
| Data Warehousing | 16 | 0.4% | 1.3% | #100 |
| Looker | 15 | 0.4% | 1.2% | #106 |
| Unity Catalog | 13 | 0.3% | 1.0% | #125 |
| Dagster | 11 | 0.3% | 0.9% | #131 |
| ELT | 11 | 0.3% | 0.9% | #132 |
| Apache Iceberg | 10 | 0.2% | 0.8% | #144 |
| AWS Glue | 10 | 0.2% | 0.8% | #145 |
| Azure Data Factory | 10 | 0.2% | 0.8% | #146 |
| Fivetran | 9 | 0.2% | 0.7% | #156 |
| Hadoop | 9 | 0.2% | 0.7% | #158 |
| Amazon Kinesis | 8 | 0.2% | 0.6% | #169 |
| Amazon EMR | 7 | 0.2% | 0.6% | #189 |
| Apache Flink | 7 | 0.2% | 0.6% | #190 |
| Data Lake | 7 | 0.2% | 0.6% | #193 |
| Prefect | 7 | 0.2% | 0.6% | #199 |
| Amazon Athena | 6 | 0.1% | 0.5% | #205 |
| Change Data Capture | 6 | 0.1% | 0.5% | #209 |
| Data Pipelines | 6 | 0.1% | 0.5% | #210 |
| Dimensional Modeling | 6 | 0.1% | 0.5% | #213 |
| Pandas | 6 | 0.1% | 0.5% | #225 |
| Parquet | 6 | 0.1% | 0.5% | #226 |
| Azure Event Hubs | 5 | 0.1% | 0.4% | #239 |
| Data Governance | 5 | 0.1% | 0.4% | #246 |
| Microsoft Fabric | 5 | 0.1% | 0.4% | #256 |
| Stream Processing | 5 | 0.1% | 0.4% | #267 |
Role families reached
Positions naming any skill in this category
Seniority
Stated levels of positions in this category