Thanks for the upvotes.
Crawlab is a golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java, PHP and various web crawler frameworks including Scrapy, Puppeteer, Selenium. Technically you can run any spider on it. It has both English and Chinese language support.
Github Repo: https://github.com/tikazyq/crawlab
Since its launch in March, Crawlab has received a lot of positive feedbacks, especially about the flexibility and appealing Web UI. And Crawlab is evolving fast, we have developed many features through continuous iterations.
For admin you can use scrapyhub open source or also another project https://github.com/Gerapy/Gerapy
Great project nonetheless. Will likely give it a try. Keep up the excellent work!
Of course a lot of folks speak English but Chinese is also very important and will be more so in the world.
We definitely would be happy if more contributors can join Crawlab development, so we will be working on the improvement of multi-language support including English documentation, Code of conduct, Contributing.md and English communities. Our team is small (please check out the Contributors section) but from top companies in China and we would be happy to share knowledge between Chinese and non-Chinese developers.
Btw, what is the best tech community? (In China we have Wechat group)
Would be great to have an english language option on the demo login :)
And we do have an English version but not on the Login page. Will definitely add into it.