Professional Summary
10+ years work experience in full-stack software development, data analytics and project management, and author of open-source projects including Crawlab. Specialized in building end-to-end solutions from frontend interfaces to backend architectures, with extensive expertise in leading development teams and scalable platform development. I am currently focused on AI technologies including LLM, agents, AI coding, etc.
Through my blog at marvinzhang.dev, I share insights on cutting-edge technologies, best practices in software engineering, and practical applications of AI/ML in real-world scenarios.
Core Expertise
Programming Languages
- TypeScript/JavaScript
- Python
- Go
- C#
- Java
Full-Stack Technologies
- Frontend: Vue.js, React, TypeScript, HTML/CSS
- Backend: Node.js, C#, Java, Python, Go
- Cloud: Azure, AWS
- Database: MongoDB, MySQL, PG, SQL Server, Redis
- DevOps: Docker, Azure DevOps, GitHub Actions
AI/ML & Data
- AI Coding & Code Generation
- AI Agents & LLM Applications
- Power BI & Data Analytics Platforms
- ETL Pipelines & Data Integration
- Web Scraping & Automation
Architecture & DevOps
- System Design & Implementation
- AI Agent System Development
- Microservices Architecture
- Agile Framework (Scrum)
- CI/CD & DevOps Pipelines
Experience Highlights
Technical Team Lead
Currently leading a 20-person development team practicing agile framework (Scrum) for software development. Spearheading data governance initiatives with Power BI-based analytics platforms and implementing ETL data integration architectures. Researching and developing low-code solutions using Microsoft PowerApps/PowerAutomate. Leading AI initiatives including LLM integration, AI-powered automation tools, and exploring AI agent systems for enterprise workflows. Actively researching and implementing AI coding solutions to enhance development team productivity and code quality.
Crawlab Open Source Project
Author and maintainer of Crawlab, a distributed web crawler management platform supporting multiple programming languages including Python, Node.js, Go, and Java. Achieved 12k+ GitHub stars and 500k+ DockerHub downloads, adopted by major companies including Xiaomi, Siemens, and Garmin. Successfully architected and migrated the entire platform from Python + Vue 2 to Golang + Vue 3, significantly improving performance and scalability. Features include distributed task scheduling, real-time monitoring, data visualization, and comprehensive spider management with support for both code-based and visual crawler development.
AI Research & Development
Deep expertise in AI/ML technologies with focus on Large Language Models (LLMs), AI agents, and AI-powered development tools. Actively researching and implementing cutting-edge AI solutions including prompt engineering, RAG (Retrieval-Augmented Generation), and multi-agent systems. Developing AI coding assistants and automation tools that enhance developer productivity. Contributing to the AI community through technical writing, open-source projects, and exploring the intersection of AI with traditional software engineering practices.
Let's Connect
I'm always interested in discussing new opportunities, technical challenges, and innovative projects. Feel free to reach out if you'd like to collaborate or learn more about my work.