|Crawl & Scrape project - 7 root sites - 48 subsites (long term work available)
||• The script will read a list (different input files, however, the format remains the same) it can be triggered by .bat files also
• There are 7 root sites and in total 48 subsites.
• Almost all if not all data is in a table on the site (not image)
• All output formats and documentation are written
• Basic features such as enabling/disabling sites, custom crawl delay, paus...
||PHP, Java, Python, Web Scraping, Selenium Webdriver
||Jun 20, 2018
|Crawl Weixin (WeChat) and Weibo data
I would like to be able to build up a database of Weixin and Weibo posts.
You would use scrapy to do this. The data would be saved via the Django ORM.
We would run the crawls regularly (possibly once per week), and only new data would be saved in the database.
We would need to save the timestamp, message, username (if possible).
Must be able to save both English and Chinese.
||Python, Web Scraping
||Jun 20, 2018
|Selenium Multi-thread Script
||As the title mention, I would need a multi-threaded selenium script.
I would be running this against 500,000 internal address, hence the threaded part. The script would need to bypass certificate errors, an example would be for it to run against:
[login to view URL] and screen shot the page.
if you and I visit the page now it will say insecure connection, the script would need to use the b...
||Python, Yazılım Test Etme, Test Otomasyonu, Golang, Ruby
||Jun 19, 2018
|Mine a website for product data
||I need product data mined from a website and put into a spreadsheet. I am a distributor for this company, but they are too slow with getting me the data to work with. If you look at the links below, you can see different product types have different tables. I need all of the data put into a spreadsheet, or at least a few spreadsheets if needed do to table types. Also need the table to include imag...
||PHP, Web Sitesi Tasarımı, MySQL, HTML, ASP.NET
||Jun 19, 2018
|ContainerD - Docker - Live migration
||We are looking for a Vagrant and ContainerD expert to test Container CheckpointRestore and LiveCold migration between 2 VMs.
Brief technical details is:
1. Vagrant box ruby file will be used to initiate the VMs and install all tools needed.
2. ContainerD is the runtime to run containers
3. CRIU is the checkpointrestore and live migration tool between 2 test VMs
Deliverables are to provide li...
||Python, Linux, Yazılım Mimarisi, Ubuntu, Docker
||Jun 18, 2018
||Jun 18, 20184g 21s
|need php script modified
||need php script modified with html coding , java and css
||Jun 17, 2018
||Jun 17, 20184g 6s
|Crawling/scraping instagram tool
To build me a tool, which can crawl and extract information about profiles, followers likes etc. and perform specific actions like bulk message, like, follow and unfollow other users.
Exact specifics and information will be provided in the brief.
Please let me know...
||Jun 15, 2018
||Jun 15, 20182g 2s
|php, python expert and devops engineer
||I have some scrapy spiders written with python and I am try to run spiders from php.
Also I have UI for starting crawl with scrapy, but when I run the scrapy from php, it doesn't work.
php is running with apache2.
Candidate must have knowledge about python, php, devops.
||PHP, Python, Linux, Web Scraping, Yazılım Mimarisi
||Jun 14, 2018
||Jun 14, 20181g 4s
|Ecommerce Product SKU and Price Scraping | Web Crawling
We are looking for a freelancer to help us with a job of website scraping with web crawl tools and techniques. We would like to extract ecommerce product SKU's and prices from target websites provided and organise them to compare price levels on Google Sheets.
Product information must be arranged to fit the CSV file and include at least product SKU, vendor, retail price and final pri...
||Veri Girişi, Excel, Web Scraping, İnternet Araştırması, Veri Madenciliği
||Jun 14, 2018
||Jun 14, 201820s 22a
|I want to create a price research web app that collects sales data about products
||We are looking to create a price research web app that collects sales data about products from different websites. It should be able to crawl other websites and retrieve sales data and store on our database. Check out [login to view URL] for an idea of what we are looking to achieve. Timescale 2-3 months
||PHP, Veri Girişi, Android, MySQL, Uygulama Geliştiricisi
||Jun 13, 2018
||Jun 13, 2018Bitiyor