dagster-hf-datasets
dagster-hf-datasets is an open-source Python package that integrates Hugging Face Datasets with Dagster, enabling data engineers to easily incorporate dataset loading and processing into their ETL and ML pipelines. It is designed for use in modern data workflows.
Open SourceApache-2.0CLI
54stars
46forks
5features
2024since
Overview
5 featuresdagster-hf-datasets sits in PulseGate's Frameworks & SDKs category. It focuses on integrating Hugging Face Datasets into Dagster data pipelines for streamlined ETL and ML workflows. It is built as an open-source project for data engineers. The project is open source (Apache-2.0). It ships for the command line.
It is developed by Dagster Community, and it first shipped in 2024. The project is developed in the open on GitHub with 54 stars and 86 commits in the last 90 days. Among its 5 catalogued features are dagster integration, Hugging Face datasets, and ETL support.
Summary written by a language model from the project’s public pages.
- Dagster integration
- Hugging Face datasets
- ETL support
- MLops compatible
- Data pipeline components
Tags
dagster-integrationhuggingface-datasetsmlops-pipelineetl-componentpython-package
Built with & integrations
Runs on
CLI
Trust & compliance
License
Apache-2.0
Verified signals
Indexing history
What PulseGate has recorded for this listing
Nothing recorded for this listing in this window.
Frequently asked questions about dagster-hf-datasets
- What is dagster-hf-datasets?
- Dagster-hf-datasets focuses on integrating Hugging Face Datasets into Dagster data pipelines for streamlined ETL and ML workflows. It is catalogued under Frameworks & SDKs on PulseGate.
- Who should use dagster-hf-datasets?
- dagster-hf-datasets is an open-source project built for data engineers.
- Does dagster-hf-datasets have a free plan?
- Yes — dagster-hf-datasets is open source under the Apache-2.0 license and free to use.
- What platforms does dagster-hf-datasets run on?
- dagster-hf-datasets runs on the command line.
- Is dagster-hf-datasets still maintained?
- The GitHub repository shows 86 commits in the last 90 days.
- Who makes dagster-hf-datasets?
- dagster-hf-datasets is developed by Dagster Community.
- When did dagster-hf-datasets launch?
- dagster-hf-datasets first shipped in 2024.
- Is dagster-hf-datasets open source?
- Yes — dagster-hf-datasets is open source under the Apache-2.0 license, developed on GitHub.
Similar apps
Closest matches by what these projects do