8+ years in data ingestion, web scraping at scale, and ETL pipeline architecture — all within a 10-year tenure at a single company. Currently leading a team of 8 engineers transitioning to full medallion-architecture ETL pipelines processing 5M+ records/day.
View Projects ↗
Data Engineer based in Bandung, Indonesia with a decade of experience across data validation, scraping engineering, and pipeline architecture. Strong background in Python async stacks, Kubernetes-based orchestration, and resilient ingestion systems for social media and e-commerce data. Currently building and managing multi-source ETL pipelines processing 5M+ records/day.
Leading the data engineering team's transition to full ETL pipeline architecture across 8 engineers. Architecting multi-source pipelines ingesting Instagram, TikTok, Twitter/X, and news data into MySQL & MongoDB — processing 5M+ records/day. Redesigned core ingestion around medallion layering (bronze/silver/gold), cutting batch processing time 2-3x and reducing latency from minutes to seconds.
Led an 11-person scraper engineering team owning the data ingestion/extraction layer across social media, e-commerce, and news sources. Built and scaled Smart Crawler — a centralized multi-platform crawling engine on Kubernetes with Airflow scheduling and Kafka queuing. Improved scraping resource efficiency 3-5x without scaling the bot account pool.
Built and maintained scrapers for Smart Crawler covering social media and e-commerce. Implemented async pipelines (aiohttp, Scrapy) with proxy rotation and rate-limit handling. Designed Kafka producer/consumer architecture decoupling ingestion from downstream processing.
Led a 12-person Data Validation team managing QA workflows and delivery timelines across multiple concurrent client projects. Verified crawled data accuracy against original sources and implemented correction workflows to maintain dataset reliability.
Built scrapers and ingestion pipelines for Clipper (1,000+ media sources), DOSM (10-12 government sources), and Smart City (15+ sources) across news, social media, and government data portals in Indonesia.
8+ years designing ingestion systems, ETL pipelines, and scraping infrastructure at scale. From one-time data collection to production-grade medallion architecture — I deliver clean, structured, and reliable data for your business.
Design and build multi-source ingestion pipelines with medallion layering (bronze/silver/gold), processing millions of records reliably at scale.
Scrapy/aiohttp scrapers with proxy rotation, rate-limit handling, and anti-bot resilience for social media and e-commerce platforms.
FastAPI microservices and Docker/Kubernetes setups for data-driven products and internal tooling.
A selection of open-source projects covering data scraping, real-time pipelines, and backend automation systems.
Production-grade system streaming live crypto market data from Binance WebSocket API into Kafka and Elasticsearch. Supports Spark, PostgreSQL, and a Streamlit dashboard for analytics.
Config-driven TikTok scraper supporting keyword search, user posts, and stories. Routes data to Kafka, Elasticsearch, or file output.
Fully async, config-driven tweet scraper using Nitter mirror sites. Ships collected data to Kafka, Elasticsearch, file, or stdout.
Scrapes product listings, shop info, and reviews from Tokopedia and Shopee. Streams normalized documents into Kafka or Elasticsearch.
Delivered high-quality data solutions with great communication and reliability. Highly recommended for complex data engineering projects.
Very good.
Incredibly happy with this order. Details were descriptive and he gathered as much info as possible. Excited for the future to develop strategies to get warmer leads. Def will be booking again.
Muhamad did a great job getting tons of data in a very short amount of time. He was very responsive and understood exactly what I was looking for. I highly recommend working with him.
Delivered a dataset on a specific topic of interest by scrapping twitter.
Everything was perfect, 100% recommendation.
Working with Wildan on Fiverr was an excellent experience from start to finish. His extensive knowledge in technical research and code execution is very evident in the quality of his work. Everything he delivered was clean, efficient and well-documented. What impressed me even more was his professionalism and dedication to client satisfaction. He generously offered more than three revisions after delivery. Even after the gig was completed, he remained supportive and responsive. I will definitely work with Wildan again in the future. Highly recommended for anyone looking for a skilled, dependable and professional developer.
Great work! Executed exactly what was expected.
Thank you for this work. Easy going and super quick! I will be checking for more work and hope to future projects together!
Absolutely gobsmacked. Exceeded expectations and will definitely be buying again. Fast, effective, easy, actionable... Just absolutely perfect service and result.
Very good service.
I had an outstanding experience working with this freelancer. From the very beginning, communication was smooth, proactive, and incredibly helpful. Their attention to detail is exceptional — refined, polished, and delivered at a standard that exceeded my expectations. The value provided for the price is truly impressive. I would not hesitate to return for future projects. If you're considering hiring this seller, I can confidently say you will be in very good hands.
Very satisfied.
Absolutely outstanding experience. The delivery was fast, detailed, and incredibly well-organized. Communication was excellent the entire way through — quick responses, thoughtful clarifications, and a clear understanding of what I was trying to achieve. What really impressed me was the extra attention to detail: the formatting, the categorisation, and the effort to make the data immediately actionable. Highly recommend this seller.
Amazing job did exactly what i was looking for!
This is my first time working with Muhamad Wildan. He was super engaged and polite and delivered the project for a good price and 2 days ahead of schedule, which is amazing! The quality of his work exceeded expectations, too. I will be working with him on further projects.
Super fast delivery and great communication! The seller even sent sample data beforehand to make sure we were talking about the same thing. Everything went smoothly — highly recommended!
So amazing, so thorough, communicative, and great work — don't hesitate to purchase.
Excellent on-time service; would use again; breeze to work with; very professional!
Very good thank you.
Could not recommend more highly. Excellent communication, super-responsive after-sales service, very pleased.
Wildan really helped me with data scraping, and the results were very fast, accurate, and truly satisfying. He's communicative and responsive, making it easy to get things done smoothly. I'd highly recommend him for any professional data scraping or similar work.
Another perfect delivery.
Listened to exactly what we want and delivered in really good time. Highly recommend.
Smashed it again, highly recommended ⭐️⭐️⭐️⭐️⭐️
Delivered flawlessly, very flexible on budget and scope.
Thanks, quick and precise delivery.
Precise delivery, included everything and more than what we needed!
Swift delivery and smooth communication!
He provided exactly what I asked for in a very timely manner. I will definitely use him again for this type of project. I encourage everyone else to do the same.
Working with Muhamad Wildan was as always an absolute pleasure! His attention to details and ability to exceed expectations made the project shine, coupled with his quick responsiveness and fluent communication. It's my third order and I will never go to another freelancer for this type of work, he's really the best.
Wildan is by far the best freelancer I've worked with on Fiverr. His communication is excellent, and he brings a sharp, solution-oriented mindset to every task. The speed of his work exceeded my expectations, and most importantly, I know I can trust him. This was my second order with Wildan, and I'm already placing another.
Muhamad Wildan truly exceeded expectations in the data scraping project. His proactive communication and language fluency made collaboration smooth and enjoyable, ensuring timely delivery and quality work. HIGHLY recommend working with him! 🙌
Quick work and delivered what was expected. It was my third order.
Quick work and delivered what was expected. It was my second order.
Quick work and delivered what was expected.
The bot was not easy to build but Muhamed was able to build it and deliver it perfectly on time. I recommend him, he is very knowledgeable.
Quick to deliver.
Muhamad was easy to work with, and delivered exactly what I was looking for - earlier than expected!
Good freelancer to work with. Muhamad delivered good work on this project and I enjoyed working with him. His communication was top-notch, he met all deadlines, and his skills were very strong. He also helped me immensely with a query I had. I enjoyed working with Muhamad and will likely have additional jobs for him in the future.
Quick delivery on top of amazing customer service! Wildan readily listens to my request and was able to offer custom solutions.
Was executed fast! Can't wait to reach out to those accounts!
I am extremely satisfied with Muhamad Wildan's performance for my data scraping project. He was highly professional, responsive, and paid great attention to detail in fulfilling every request. The results were incredibly accurate and well-organized. I will definitely use his services again in the future and highly recommend him!
Open to freelance projects, collaborations, or full-time opportunities. Feel free to reach out through any platform below.