#DataSets

i’ve been messin around with some custom filter pipelines lately. basically i wanted to see where the real "exhaustion points" are in the fulton county residential universe.…

Was building a training corpus and kept hitting the official API's 500 comment truncation limit. Found a gateway that recursively resolves full thread depth and has historical archive access which the official API just doesn't have.…

Hi is anyone aware of a data source i can use to approximate the cost of a gallon of regular fuel across the US at the zip code level? I've tried to query from the GasBuddy GraphQL API but my python script is failing. Is there anywhere else i can look?…

Dataset for fine-tuning compliance assistants. Each pair includes: - A practical SME-facing question ("Can I use pre-ticked consent boxes?") - An answer with specific UK GDPR article references, ICO guidance by name, and actionable steps - Source…

Hello, so for the past year or so i have accumulated data from a lot of different stores and a few marketplaces. I have over 4m products with stock and price history. My question is how legal is it to sell this data and where cand I do that?…

Hi Everyone, I’m looking for large-scale Indian audio/music datasets (100,000+ hours preferred) mainly containing: - Indian songs/music - Vocals - Bollywood music - Regional language audio - Speech + music mixed data - Instrumental/music tracks Purpose is…

Just finished a few weeks of testing proxy providers for a project that needs accurate location data. pulling localized pricing, so if the geo is wrong the whole thing is useless.…

MIMIC-III has NICU data and is relatively easy to get access to (i.e. just fill out a form on PhysioNet, take an ethics course). Most others, e.g. Pediatrix, seem to only give you data if you have a formal partnership with them via your university.…

I recently rebuilt how I pull the executive roster (CEO plus named officers, with titles) for US public companies straight from SEC data. Coverage went from about 6,400 officer rows across 3,242 companies to roughly 62,500 rows across 24,358 companies, so…

Looking for the Huangshui River Water Quality dataset from IEEE DataPort for ML/environmental analysis. Dataset: https://ieee-dataport.org/documents/water-quaility-huangshui-river Need help with: - download access - dataset format/docs - similar datasets…

I’ve been thinking about the role of synthetic datasets in data projects, especially now that LLMs and generative models make data generation much easier.…

I was building GreenCalculus (carbon accounting/calculator platform — disclosure: it’s my project) and kept running into the same problem: There’s no single clean, open, version-controlled emission factor dataset aligned to IPCC AR6 GWP-100.…

I've been working more on unifying all my datasets, adding live collectors. So far earthquakes, tsunamis, and volcanos are the strongest, hurricanes are pretty solid but wildfires are taking some more work since they're more crossed sourced and each…

Originally published at norvik.tech Introduction An in-depth analysis of Human...

Nature - Author Correction: In vitro characterization of the human segmentation clock

Constructing datasets from primary sources is one of the costliest tasks in empirical economics. We propose Deep Research on a Loop (DRIL), a methodology that uses AI agents to assemble datasets from publicly available sources.…

A no-training graph heuristic beats generative recommenders on 10 of 14 benchmarks, exposing shortcut-solvable datasets. Relative NDCG@10 gains hit 44

Notes from getting F5-TTS, StyleTTS2, kokoro, and whisper.cpp to run on a 2010-era AMD Phenom II X6.

From Dev.to - computervision: Why Synthetic Data is the Secret to Fixing Computer Vision Edge Cases

Originally published at norvik.tech Introduction Explore the JSONL format, its...