#InteligenciaArtificial #CommonCrawl #DatosMasivos #IA #PrivacidadDigital #Tecnologia
#InteligenciaArtificial #CommonCrawl #DatosMasivos #IA #PrivacidadDigital #Tecnologia
Het zou met data van openwebsearch.eu en/of commoncrawl meetbaar gemaakt kunnen worden, door over aantal maanden te kijken of er een wijziging te zien is in de data. Bv fractie php sites, fractie sites met […]
Het zou met data van openwebsearch.eu en/of commoncrawl meetbaar gemaakt kunnen worden, door over aantal maanden te kijken of er een wijziging te zien is in de data. Bv fractie php sites, fractie sites met […]
Free block AI bots robots.txt generator. Generate rules to block GPTBot, ClaudeBot, CommonCrawl, and AI scrape...
🔗 Free tool: https://allmytools.tech/tools/ai-bot-blocker #tools
Free block AI bots robots.txt generator. Generate rules to block GPTBot, ClaudeBot, CommonCrawl, and AI scrape...
🔗 Free tool: https://allmytools.tech/tools/ai-bot-blocker #tools
1/
1/
https://commoncrawl.org/blog/web-graph-embeddings-an-experimental-dataset-release
https://commoncrawl.org/blog/web-graph-embeddings-an-experimental-dataset-release
https://huggingface.co/spaces/commoncrawl/llms.txt-report has info and https://huggingface.co/spaces/commoncrawl/llms.txt-report has some very reasonably sized parquet versions of the WARC files that I may hack on […]
https://huggingface.co/spaces/commoncrawl/llms.txt-report has info and https://huggingface.co/spaces/commoncrawl/llms.txt-report has some very reasonably sized parquet versions of the WARC files that I may hack on […]
courionai.com/news/2026-08-30-laion-big-video-dataset
#AI #TrainingData #OpenSource
courionai.com/news/2026-08-30-laion-big-video-dataset
#AI #TrainingData #OpenSource
🔗 aidailypost.com/news/laion-r...
🔗 aidailypost.com/news/laion-r...
- 1.3B video URLs from CommonCrawl
- 80M downloaded videos
- 10M video hours
- 55M captioned clips
- 300M frame-caption pairs
🌐: projects.laion.ai/bvd/
🧵👇
- 1.3B video URLs from CommonCrawl
- 80M downloaded videos
- 10M video hours
- 55M captioned clips
- 300M frame-caption pairs
🌐: projects.laion.ai/bvd/
🧵👇
- Extracted 1.3B safe/platform-specific video URLs
- Downloaded ~80M videos using thousands of distributed workers
- Processed videos into clips, audio segments, and frames
- Extracted 1.3B safe/platform-specific video URLs
- Downloaded ~80M videos using thousands of distributed workers
- Processed videos into clips, audio segments, and frames
Huge thanks to grass.io for providing us access to its data infrastructure in support of this release and @hf.co for storage!
🌐: projects.laion.ai/bvd/
📄: arxiv.org/abs/2608.24845
Huge thanks to grass.io for providing us access to its data infrastructure in support of this release and @hf.co for storage!
🌐: projects.laion.ai/bvd/
📄: arxiv.org/abs/2608.24845