I need a web scraper written for the following url:
[url removed, login to view]
All of the information needed is available on the main page. The number of rows will vary.
The output should be a pipe (|) delimited file with the following column mappings:
origin_city --> data located in the "Origin City" column
origin_state --> data located in the "ST" column located between “Origin City” and “Destination City”
ship_date --> the date from the "Pickup" column changed to the YYYY-MM-DD format
destination_city --> data located in the "Destination City” column
destination_state --> data located in the "ST” column located between “Destination City” and “Payment”
receive_date --> leave blank
trailer_type --> data in the "TRLR" column
load_size --> data in “F/L” column, if "F" then change put "FULL" if "L" change to "PARTIAL"
weight --> data in the "WEIGHT" column, if 0 or blank leave blank
length --> data in “Length” column, if 0 or blank leave blank
width --> leave blank
height --> leave blank
trip_miles --> data in the "MILES" column
pay_rate --> data in the “Payment” column, if blank then leave it blank
contact_phone --> data located in the "PHONE" column
contact_name --> leave blank
tarp_required --> leave blank
comment --> leave blank
load_number --> leave blank
commodity --> leave blank
The first line of the output should contain all of the column headers.
Any field that contain no data should be left blank.
Please do not use words like "null" or "blank" in blank columns.
Below is a sample output of the first 5 columns using sample data:
The deliverable will be a Perl .pl file that must run on
Ubuntu Linux and must use Modern::Perl. The Perl .pl file
should be called '[url removed, login to view]' and the output file should be
called '[url removed, login to view]'
It will be scheduled in cron to run unattended every 15 minutes.
We suggest WWW::Mechanize but you are free to use other Perl libraries.
Please specific what language/OS/tools you will be using in your bid.
Also, please include the word "raccoon" in your bid so I know that
you read this description.
I can create same script as before (WWW::Mechanize + HTML::TreeBuilder::LibXML for parsing). Thanks. Roman
22 freelancers are bidding on average $175 for this job
hello "raccoon" I've checked your spec, and I can create a modern Perl script for you to run from Ubuntu server.
Hi sir, This is kimi and I am scraping expert, I have did too many scraping projects, please check my profile page then you will know. https://www.freelancer.com/u/mantislin.html Can you tell me Daha Fazla
Hi I can provide a desktop application in C# that can scrape the data. Thanks
raccoon Hi, I am Python developer with 6 years experience working on web scraping and data mining as well as building useful scripts for my clients. I just checked the description you have provided regarding the Daha Fazla
Hello! I'm web-scraping and web-automation expert and i can help you. I develop web scraping scripts more 3 years and i have more 500 finished projects (ecommerce sites, amazon, google, facebook, yelp, etc...) I can Daha Fazla
I have thoroughly studied your project detail, I can do your project within 1 day and with 100% accuracy. I am doing web scraping from last 5 years and your task is easy for me. after complete satisfaction and tes Daha Fazla
Hello sir I can give you scraper for your URL. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well. Scraping/Crawlingworking experience of more then 8 year A Daha Fazla
Dear Employer, I will scrape all the data for you using C#, Python, imacros etc. I have scrapped data and images from following website as well as APIs. I know how to bypass Captchas and fasten the process by using Daha Fazla
Hello. I can do it the BEST for you as I have read the details completely. Please have a look onto my employer's reviews on my profile so you can get an idea of my quality work :) Inbox me so we can discuss and con Daha Fazla
I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably Daha Fazla
Hello, I am a full-time freelancer and do web scraping jobs only. I am creating automated data extraction systems for more than two years now. Any security can be bypassed. I have already scraped millions of records o Daha Fazla
Hello, I have read the description till the end: raccoon I am coming back to the site after 8 years of absence. Perl is my favorite programming language, outcome of my work is always the highest quality code, the Daha Fazla
Hello , I have been programming in C/C++ for both linux and windows for more than 6 years now. I have also written various network applications some of which are down to the IP packet level. I also have previous experi Daha Fazla
raccoon Answers to you questions: 1) I will use perl language as you want. But also I`m writing scrapers with python and php. 2) Script will run on linux. Also iI can port it to Windows if needed. I prefer to u Daha Fazla
Hi Good day. Im highly interested with your job offer. I have done this kind of jobs before and i can send a sample program as a proof. I can start working on this project as soon as the job is awarded.
Hello Over the last 7 years, I have worked for several clients. Joined Freelancer with over 7 years of experience in, Data entry, LinkedIn Lead generation, Google Research Expert, Web scraping My Skills: PHP,Java,Jav Daha Fazla
Hi I am Zubair, expert in web scrapping, Data mining, and web research. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Rega Daha Fazla
RACCOON ! hello, it's third bid i'm making on your project, i'm a professional scrappers developer with 10 years experience here on freelancer, give me this task and i'll complete all your 3 scrappers for $250. will us Daha Fazla