Dagster Data Engineering Glossary:

Shard

A method of splitting and storing a single logical dataset in multiple databases to spread the load, enhancing the performance and enabling horizontal scaling.

Other data engineering terms related to 'Shard'

Write-Ahead Logging (WAL)

A method where changes are written to a log before they are applied, ensuring data integrity and consistency by providing a recovery mechanism in case of system failures.

Zero-Day Exploit

An attack that targets software vulnerabilities that are unknown

Zoning

In storage area networking, zoning is the process of allocating resources in a network to communicate only with each other and isolated from other resources, improving security and performance.

Zookeeper

An open-source technology that provides a centralized service for maintaining configuration information, naming, and providing distributed synchronization and group services.

Zone Replication

The process of replicating data across different zones in a multi-zone environment, usually for data redundancy and availability.

Zettabyte

A unit of digital information storage used to denote the size of data. It is equivalent to one sextillion (10^21) bytes or 1000 exabytes.