# Apache Spark (including Amazon EMR and Google Cloud Dataproc) · compute · 2018

Revision 1 (11 October 2026) · Modeled snapshot · through 8 October 2026.

All figures are research-informed estimates of analytical activity. Significant errors may remain; decimal places do not imply measurement precision.

6.5% of the full compute layer.

[Apache Spark (including Amazon EMR and Google Cloud Dataproc)](https://history.columnar.tech/technologies/compute/spark.md): historical names and annual shares.

Includes Spark workloads on Amazon EMR and Google Cloud Dataproc, alongside other hosted and self-managed Spark deployments. EMR workloads using Hadoop/Hive and Presto are counted with those engines. Databricks has a separate box.

Connections below describe the whole Apache Spark (including Amazon EMR and Google Cloud Dataproc) engine. Access and storage mixes are estimated separately; they are not a joint interface-to-storage distribution.

## Access use within this engine

| Option | Share of engine activity | Share of full access layer |
| --- | --- | --- |
| [Apache Spark (including Amazon EMR and Google Cloud Dataproc) vendor-specific interface](https://history.columnar.tech/technologies/access/vendor-spark.md) | 49.3% | 3.2% |
| [Other language/portable APIs](https://history.columnar.tech/technologies/access/other-api.md) | 28.3% | 1.8% |
| [JDBC](https://history.columnar.tech/technologies/access/jdbc.md) | 14.5% | 0.9% |
| [ODBC](https://history.columnar.tech/technologies/access/odbc.md) | 4.2% | 0.3% |
| [Python DB-API (other drivers)](https://history.columnar.tech/technologies/access/python.md) | 3.7% | 0.2% |

## Storage use within this engine

| Option | Share of engine activity | Share of full storage layer |
| --- | --- | --- |
| [Standalone Parquet on object storage](https://history.columnar.tech/technologies/storage/parquet-object.md) | 28% | 1.8% |
| [Standalone Parquet on HDFS](https://history.columnar.tech/technologies/storage/parquet-hdfs.md) | 25% | 1.6% |
| [HDFS text/SequenceFile/RCFile/Avro](https://history.columnar.tech/technologies/storage/hdfs-row.md) | 10% | 0.7% |
| [Standalone ORC on HDFS](https://history.columnar.tech/technologies/storage/orc-hdfs.md) | 10% | 0.7% |
| [Object-store CSV/text/Avro](https://history.columnar.tech/technologies/storage/object-row.md) | 8% | 0.5% |
| [Federated relational native stores (vendor unallocated)](https://history.columnar.tech/technologies/storage/remote-relational.md) | 6% | 0.4% |
| [Local/shared row files](https://history.columnar.tech/technologies/storage/legacy-local.md) | 4% | 0.3% |
| [Standalone ORC on object storage](https://history.columnar.tech/technologies/storage/orc-object.md) | 3% | 0.2% |
| [Hudi-authoritative tables](https://history.columnar.tech/technologies/storage/hudi.md) | 3% | 0.2% |
| [Standalone Parquet on local/shared filesystems](https://history.columnar.tech/technologies/storage/parquet-local.md) | 2% | 0.1% |
| [Iceberg-authoritative tables](https://history.columnar.tech/technologies/storage/iceberg.md) | 1% | <0.1% |

[All percentages for 2018](https://history.columnar.tech/years/2018.md)

---

[Markdown overview](https://history.columnar.tech/index.md) · [Interactive visualization](https://history.columnar.tech/?2018) · [Methodology](https://history.columnar.tech/methodology.md) · [Terms of use](https://history.columnar.tech/terms.md)

© 2026 Columnar Technologies Inc.