Skip to content

Data operators

Public

The Data family contains 3 operators. Pure-function data shaping: parse, transform, list ops.

Operation-rich list manipulation: map, filter, sort, chunk, flatten, dedupe, aggregate, split.

Version 1.0.0 · Semantics passthrough · Idempotent

FieldTypeRequiredDefaultDescription
chunk_sizeintegerno
expressionstringnoCEL expression for map/filter/sort.
operation”map” | “filter” | “sort” | “chunk” | “flatten” | “dedupe” | “aggregate” | “split”yes
sort_direction”asc” | “desc”no"asc"
PortTypeRequiredDescription
inputarrayyesInput
PortTypeRequiredDescription
outputarraynoOutput

Operation-rich object manipulation: assign, select, rename, merge.

Version 1.0.0 · Semantics passthrough · Idempotent

FieldTypeRequiredDefaultDescription
expressionstringnoCEL expression or field mapping.
fieldsstring[]noField names for select/rename.
operation”assign” | “select” | “rename” | “merge”yes
PortTypeRequiredDescription
inputanyyesInput
PortTypeRequiredDescription
outputanynoOutput

Converts between formats: JSON, CSV, markdown table, URL-encoded, plain text.

Version 1.0.0 · Semantics passthrough · Idempotent

FieldTypeRequiredDefaultDescription
operation”parse_json” | “stringify_json” | “parse_csv” | “parse_markdown_table” | “parse_urlencoded” | “stringify_text”yes
optionsobjectnoFormat-specific options (delimiter, headers, etc.).
PortTypeRequiredDescription
inputanyyesInput
PortTypeRequiredDescription
outputanynoOutput

Every operator above is rendered from its JSON schema in /opt/glyph/schemas/operators/:

  • schemas/operators/data.list.json
  • schemas/operators/data.object.json
  • schemas/operators/data.parse.json