Skip to content

PR: Restructure image-text-to-text (VLM) datasets: new fields, filters and additional VLM datasets - #94

Merged
js2552 merged 11 commits into
mainfrom
feature/dataset-benchmarking
Oct 26, 2026
Merged

js2552 merged 11 commits into
mainfrom
feature/dataset-benchmarking

Conversation

@uchandar29

Copy link
Copy Markdown
Contributor

Summary

Moves image-text-to-text (VLM) datasets to a new metadata structure and updates the dataset browser to use it.

Data

  • New fields on VLM entries: num_qa_pairs, num_images, conversation_type, qa_type, optional hf_configs; agricultural_task is now a list.
  • machine_learning_task renamed image-text-to-text → image_text_to_text.
  • Removed fields no data uses anymore (num_rows, conversation_format, task_dimensions, num_task_types) and unused display-label overrides.
  • "View Original Dataset" link when parent_dataset is a URL.
  • Added additional VLM including LeafNet family, plus sample images for the VLM datasets.

Filters

  • New: QA Pairs (log-scale range slider, 1k–766k) and Conversation Type.
  • Agricultural Task filter (Datasets and Leaderboard) leaves out VLM tasks until they're standardized.

uchandar29 and others added 11 commits August 26, 2026 13:58
…ixed metric crashes when unavailable and polished benchmark modal UI

- Show N/A instead of hiding empty score axes; narrow score boxes

- Make Exact Duplicates collapsible; tighten stat spacing

- Resolve iNatAg/iNatAg-mini embeddings from their own subdirectories

- Show a no embeddings found message instead of a fake demo scatter
…lter, VLM dataset images

- Updated VLM dataset card with updated details from the paper. Added additional fields like qa_type, conversation_type, num_qa_pairs

- Relevant changes to UI to accomodate updated card details for VLM datasets

 - Added filters for QA Pair number, Conversation Type and QA Type

- Added sample images for VLM datasets

Updates to semantic search filter with updated details of VLM datasets for effecient filtering
- Overrides image-text-to-text datasets metadata to updated fields. Value renamed to image_text_to_text
@js2552
js2552 merged commit 564a152 into main Oct 26, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants