Skip to content

feat(datasets): add generic 'datasets trigger' passthrough command#16

Open
karaposu wants to merge 1 commit into
brightdata:devfrom
karaposu:dev
Open

feat(datasets): add generic 'datasets trigger' passthrough command#16
karaposu wants to merge 1 commit into
brightdata:devfrom
karaposu:dev

Conversation

@karaposu

@karaposu karaposu commented Jul 1, 2026

Copy link
Copy Markdown
  • New faithful wrapper over /datasets/v3/trigger with zero per-dataset knowledge: --dataset/--dataset-id, --type, --discover-by, --input-file/--input (JSON or JSONL), --limit, --include-errors/--no-include-errors, --format, --timeout, --async.
  • Sends the user's input array verbatim (bypasses build_input), unlocking discovery mode (type=discover_new + discover_by) that the pipelines command couldn't express.
  • Reuses the existing trigger/poll/format path (poll_until, resolve_format, snapshot fetch); --async hands off to the existing status command.
  • Exports the shared engine pieces from dataset.ts (additive, non-breaking) and registers the command in index.ts.
  • Adds 13 tests; full suite green at 352.

- New faithful wrapper over /datasets/v3/trigger with zero per-dataset knowledge: --dataset/--dataset-id, --type, --discover-by, --input-file/--input (JSON or JSONL), --limit, --include-errors/--no-include-errors, --format, --timeout, --async.
- Sends the user's input array verbatim (bypasses build_input), unlocking discovery mode (type=discover_new + discover_by) that the pipelines command couldn't express.
- Reuses the existing trigger/poll/format path (poll_until, resolve_format, snapshot fetch); --async hands off to the existing status command.
- Exports the shared engine pieces from dataset.ts (additive, non-breaking) and registers the command in index.ts.
- Adds 13 tests; full suite green at 352.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant