|Crawl & Scrape project - 7 root sites - 48 subsites (long term work available)
||• The script will read a list (different input files, however, the format remains the same) it can be triggered by .bat files also
• There are 7 root sites and in total 48 subsites.
• Almost all if not all data is in a table on the site (not image)
• All output formats and documentation are written
• Basic features such as enabling/disabling sites, custom crawl delay, paus...
||PHP, Java, Python, Web Scraping, Selenium Webdriver
||Jun 20, 2018
|Horizon view vmware help
||Need someone who knows well about horizon view vmware to fix an error.
Error: customization operation timeout. Pairing state: in pairing.. this doesn’t happen to all the vm’s in this pool, only a small portion. I have 12 vdi’s in a desktop pool out of which 6 are having this error.
If i delete the machine from view admin portal, then view composer tries to provision the vdi and...
||Jun 18, 2018
||Jun 18, 20184g 19s
|Improve web scraping project on Google App Script
||We created a project on Google App Script for web scraping, there are different script files in the project. The Google App Script project was scheduled to web scraping one of webpage each weekday, and export to CSV.
However, there are too many lines on each script file, there are looping, the workflow is complicated. As a result, its timeout sometimes, and unable to finish the whole process.
||Jun 18, 2018
||Jun 18, 20184g 8s
- Server part: convert apis written in nodejs+mysql to given structure in nodejs hapi dynamodb.
- Document part: Clean code and write optimized code and follow given structure.
1. The code is responsible for reading data from several given api's and storing that (historical) data in database as needed.
2. Creating our own api data points from the server to be fetched...
||Java, NoSQL Couch & Mongo, MySQL, node.js, Elasticsearch
||Jun 15, 2018
||Jun 15, 20182g