Data prep for LLM application builders

[Bytes-Explorer]

Hello! This is really cool collection.

I want to propose adding https://github.com/IBM/data-prep-kit as tools for quick data preparation as it may help LLM app developers started quickly. Our team developed these tools for our internal usage, but we believe these are widely applicable and have open sourced them.

I can raise a PR, if we think this is meaningful.

[mlabonne]

Hi, thanks for your suggestion, this is super relevant. It would be even better to showcase it in the LLM datasets (https://github.com/mlabonne/llm-datasets) repo I made with other tools. I'd be happy to accept a PR there if you're interested