Intelligent Data Processing
Cleaning, normalizing, deduplicating and classifying data before and during AI automation.
Articles in Intelligent Data Processing
- Regex Text Preprocessing and ReDoS Safety for AI Automation — Cheap deterministic preprocessing improves accuracy and cuts token cost, but one careless regex can freeze a worker on hostile input. This guide covers practical patterns, redaction limits, ReDoS causes and defences, and how to test them.
- Normalizing Phone Numbers, Addresses and Names Before AI Automation — Messy contact data makes automations create duplicates, mis-greet customers and route wrongly. This guide covers safe normalisation of emails, phones, names and addresses, conservative matching, and where a language model helps or gets in the way.
- Designing a Classification Label Taxonomy for AI Workflows — A classifier can only be as good as its categories. Overlapping, vague or too many labels cause most 'model errors'. Here is how to design, document, test and version a taxonomy that both models and humans can apply consistently.
- Deduplicate Records Before They Reach Your AI Automation — A CRM export with the same lead synced twice looks harmless until an AI automation drafts two different outreach emails to the same person. Catching duplicates before processing beats catching them after.