Dagster Data Engineering Glossary:

Avro

A binary serialization format developed within the Apache Hadoop project, compact, fast, and suitable for serializing large amounts of data. It uses JSON for defining data types and protocols, and it serializes data in a compact binary format.

Other data engineering terms related to 'Avro'

Write-Ahead Logging (WAL)

A method where changes are written to a log before they are applied, ensuring data integrity and consistency by providing a recovery mechanism in case of system failures.

Zero-Day Exploit

An attack that targets software vulnerabilities that are unknown

Zoning

In storage area networking, zoning is the process of allocating resources in a network to communicate only with each other and isolated from other resources, improving security and performance.

Zookeeper

An open-source technology that provides a centralized service for maintaining configuration information, naming, and providing distributed synchronization and group services.

Zone Replication

The process of replicating data across different zones in a multi-zone environment, usually for data redundancy and availability.

Zettabyte

A unit of digital information storage used to denote the size of data. It is equivalent to one sextillion (10^21) bytes or 1000 exabytes.