Skip to content

Epic: Data layer — CSR sparse support, slices vs Vec in Array traits, parquet IO #455

Description

@Mec-iS

Tracking issue for data-layer work. Highest blast radius of all epics: the Array/Array1/Array2 traits are foundational. Do not start code before an RFC is agreed here.

Member issues

Why grouped

#156 and #199 both reshape the core array abstractions every algorithm builds on; #249 adds an IO surface whose dependency weight and wasm story need a joint call with the data-model work. Sequencing them together prevents repeated breaking changes to the same traits.

Constraints (repo conventions)

  • Keep the bespoke numeric/linalg system and its performance intact — known-answer tests must pass unchanged.
  • Zero-copy access via iterator(...) / view traits is mandatory for any new storage layout.
  • Dataset serialization helpers must not trigger file writes on wasm targets.
  • New dependencies need a size/feature-gate justification (parquet is heavy — expect a dedicated optional feature).

RFC requirements

Post a short RFC comment covering: trait-level changes and their breaking-change scope, CSR coverage plan (which algorithms first), parquet feature gating, no_std impact (v0.7 roadmap).

Acceptance criteria

  • RFC agreed by a maintainer
  • Members implemented or explicitly descoped
  • CHANGELOG updated; breaking changes flagged in it

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    epicTracking issue grouping related large workrfc-neededRequires an agreed API/design sketch before code

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions