Specifications

• Introduction
  • Arrow Columnar Format
  • Support for Null Values
  • Primitive Layouts
  • Nested Layouts
  • Dictionary Encoded Layout
  • Run-End Encoded Layout
  • Overview of Arrow Terminology
  • Extension Types
  • Sharing Arrow data
• Arrow Columnar Format
  • Terminology
  • Data Types
  • Physical Memory Layout
  • Serialization and Interprocess Communication (IPC)
  • Implementation guidelines
• Format Versioning and Stability
  • Backward Compatibility
  • Forward Compatibility
  • Long-Term Stability
  • Pre-1.0.0 Versions
  • Post-1.0.0 Format Versions
• Changing the Apache Arrow Format Specification
  • Discussion and Voting Process
  • At Least Two Reference Implementations
  • Versioning
• Canonical Extension Types
  • Introduction
  • Official List
  • Community Extension Types
• Other Data Structures
  • Tensor (Multi-dimensional Array)
  • Sparse Tensor
• The Arrow C data interface
  • Rationale
  • Data type description – format strings
  • Structure definitions
  • Semantics
  • Example use case
  • C producer examples
  • Why two distinct structures?
  • Updating this specification
  • Inspiration
  • Language-specific protocols
• The Arrow C stream interface
  • Semantics
  • Structure definition
  • C consumer example
• The Arrow C Device data interface
  • Rationale
  • Structure definitions
  • Semantics
  • C producer example
  • Device Stream Interface
  • Interoperability with other interchange formats
  • Updating this specification
• Dissociated IPC Protocol
  • Rationale
  • The Protocol
  • Protocol Description
  • Continuing Development
• Arrow Flight RPC
  • RPC Methods and Request Patterns
  • Authentication
  • Location URIs
  • Error Handling
  • External Resources
  • Protocol Buffer Definitions
• Arrow Flight SQL
  • RPC Methods
  • Sequence Diagrams
  • External Resources
  • Protocol Buffer Definitions
• ADBC: Arrow Database Connectivity
  • Rationale
  • ADBC API Standard 1.0.0
  • Updating this specification
  • Related work
• Integration Testing
  • Strategy
  • Running integration tests
  • JSON test data format
  • Archery Integration Test Cases
• Glossary