Web scrape to database işler
Hazırda bir scrape projem var react ve node.js ile yaptığım fakat tam istediğim gibi çalıştıramadım belirli bir sitede tıklama ve navigasyon işlemleri ardından pdf indirme işlemini proxy ile yapmaya çalıştığım bir proje tam anlamıyla çalışması için yardıma ihtiyacım var
Elimizde bulunan iki program var, önceden birbirine bağlıydı, sorunsuz çalışıyordu ancak şuan çalışmıyor. Sebebini anlayamadık. Bunu düzeltecek arkadaşlar arıyoruz.
Verileri belirli filtrelere göre kazıyacak ve bir web sitesine yükleyecek bir veri kazıma program istiyorum. Program, verileri verimli bir şekilde çıkarmak ve yapılandırılmış bir biçimde depolamak için tasarlanacak. Kullanıcı, istenen veriler için filtreler ayarlayabilecek ve program, filtrelenen verileri otomatik olarak sıyıracak ve toplu bir şekilde web sitesine yükleyecek. Program ayrıca verilerin güncel olmasını sağlamak için düzenli güncellemeler gerçekleştirebilmeli. Program, modern ve verimli bir programlama dili kullanılarak geliştirilmeli. Program, tüm gereksinimleri karşıladığından emin olmak için kapsamlı bir şekilde test edilerek ve eksiksiz kaynak kodu, belgeler ve dest...
Benim shopify mağazam için başka bir siteden scrape data export programı istiyorum 30K + ürün için ve haftalık veri güncellemesi
sitesindeki tabloları ve filtreleri Google looker studio ya taşıtmak istiyorum. herkese ücretsiz belli bir alan veriyor
Selam İsmail Bey, IT Proje yönetimi konusunda 20 yılımı doldurdum. Çeşitli ülkelerde 20 den fazla projeyi yönettim. Çok garip bir şekilde, kanada at yarışları sitesi ile ilgili verdiğiniz teklifi gördüm;) verilerinin scrape edilmesi konusunda birlikte çalışmak üzere sizle iletişime geçtim. Projeyi birlikte oluşturarak bütçelendirebileceğimizi öngörüyorum.
Selected data from an industrial application database will be stored in a new dedicated-built database (PostgreSql or NoSQL). Integration with 3rd party will be supported by a Web service that will be developed.
merhabalar, tecdoc database sistemi içine gömülü yedek parça eticaret sitesi işi vermek istiyoruz. tecdoc şase sistemi içerde aktif olarak çalışacak. kataloglar ve ürün ağaçları hatasız olucak site görseli sade ve düzgün hızlı çalışır bir sistem istiyoruz. bununla ilgili ilgilenen arkadaşlar detaylı yazabilir veya iş örneklerini ekleyebilirler. örnek site olarak : megaparca - opelgm siteleri gösterilebilir.
Tec-Doc database sorguları ve tablo yapısı hakkında bilgisi olan ve sorgu konusunda yardıma ihtiyaç vardır.
Whatsapp ile database arasında kurulucak bir entegrasyonla, ilgili kullanıcı whatsapp üzerinden tetikleme sonrası karşısına gelen listeden seçeği numaraya göre ilgili raporun sonucunu döndürecektir. 'un whatsapp beta bölümünü inceleyebilirsiniz. Veya canlı bir örneği için WHO'nun telefon numarasına whatsapp üzerinden "hi" yazarak cevaplayın, karşınıza bir liste gelecektir. Gelen listeden istenilen şık seçilip cevaplandığında karşınıza o şıkla ilgili son bilgiler iletilmektedir.
Mevcut database'imizdeki bilgileri çekecek ve mevcut database'imize bilgileri yazacak müşteri paneli ihtiyacımız var.
Merhaba, Bi uygulamam var ve o uygulamada her seviye için kategori ismi ve kelimeler var. Örnek olarak; kategori ismi BEYAZ ŞEYLER, kelimeler ise ŞEKER, PAMUK, KAR. Bu şekilde 500 seviye girilmesini istiyorum. Her seviye için yaklaşık 10 kelime bulunacak. Elimde bi ingilizce veritabanı var, ordan ilham alarak kategoriler girilebilir, bunun yanında Türkiye'ye özel özgün kategoriler de yazılmasını istiyorum.
merhaba, Turkiye'deki 3 gsm operatorunun tarife bilgileri lazim. ancak malumunuz soyle bir sorun var: bu web sitelerin icerdigi tarife bilgileri (data) belli araliklarla guncelleniyor (fiyat degisikligi, tarife ekleme/cikarma, vb..) sunu merak ediyorum: acaba bir aplikasyon hazirlayip bu sitelerdeki bilgileri belli araliklarla scrape edebilirmiyiz, boylece olusturdugumuz database surekli guncel kalir. yorumlarinizi bekliyorum. Mustafa
Database Optimize ve Web Sitesinin Hızlı Açılmasını Sağlamak
Tecdoc 2012/4 dvd sindeki oem ve araç tablolarını excel veya mysql olarak almak istiyorum
Elimizde MSSQL database i mevcut sadece wamp serverdan kodu gerekli php ile yazılacak database aktarıalcak. Öğrenci girişi olacak bu database bir öğrencinin bilgilerini içeriyor bu bilgiler yurt bilgisi Okul bilgisi gibi bilgilerden oluşmaktadır.
Elimizde MySQL database i mevcut sadece wamp serverdan kodu gerekli php ile yazılacak database aktarıalcak. Öğrenci girişi olacak bu database bir öğrencinin bilgilerini içeriyor bu bilgiler yurt bilgisi Okul bilgisi gibi bilgilerden oluşmaktadır.
Hi,we are developing IOS this app, we are looking for someone who can make web service,create database and setup linux server. Merhaba,bir iphone uygulaması geliş uygulama için web servis yapabilecek,databaseleri oluşturacak ve sunucuyu kuracak birini arıyoruz.
2-3 Milyon verisi bulunan 2boyutlu yüz veritabanı oluşturulacaktıı içersinde yüze ait nitelikler tutulacaktı yüz veritabanından yüzün kime ait olduğuna dair bir arama yapan bir yazılıma ihtiyaç vardır. System tarafından browse edilen herhangi bir resmin özellikleri önce program tarafından ayrıştırılacak ve o özelliklere benzer resimler veritabanından eşleşerek çağırılacaktır. Aynı kişiye ait resimlerin gelmesi ılımın 2-3 saniye içersinde yüzün kime ait oldunu sorgulayıp doğru bir şekilde göstermesi beklenmektedir. .Bu yazılımda performans ve başarı yüzdesi esas alınacaktır. Image özellikleri herbir image için min 32*32 =1024 pix şeklinde veri tabanında tutulacaktır. Fikir verme ama&c...
I'm in need of an experienced backend developer to create a mail parser with the following specifications: - **Email Protocol:** The mail parser should support SMTP, so proficiency in this area is a must. - **Primary Goal:** The primary function of this mail parser should be storing emails in a MySQL database. If you have experience with database integration, this would be a big plus. This project requires expertise in backend development, specifically with an understanding of how SMTP works. You should also be familiar with MySQL and have experience in integrating databases into applications. Please provide examples of similar projects you've worked on in your proposal. Thank you.
...effectively handle a variety of technical issues, particularly those related to hardware, software, and network setups. Overview: I'm looking to create an MVP of an AI-assisted technical service desk tool. The goal is to prototype the core capabilities of ingesting, analyzing, and responding to support issues using machine learning techniques. Project Description: The tool will allow end users to upload tickets, logs, configs, and other pertinent files. It will parse, extract, and vectorize content to understand issues. An explainable ML model like LIME will then diagnose the problem and provide steps, code samples, etc to resolve it. The LLM will be RAG augmented based on a vector protocol of a list of sites to augment the...
Application code to implement Roomio as a web application in python. You will use the table definition posted at the end of this document.
I need a proficient Python expert to scrape recipes from a designated website to an Excel sheet. The project needs to be completed as soon as possible. You can use this open-source working scraper Key requirements: - Scraping recipe information (name, ingredients, cooking instructions, nutrition facts) from a specific website. - Outputting the scraped data in a well-organized Excel sheet. Ideal skills for this project include: - Proficiency in Python for web scraping. - Familiarity with scraping data from websites. - Excellent organizational and data management skills for outputting the data in Excel. If you can deliver this quickly and efficiently, please feel free to bid.
...proficient developer who can add a page to my website that interfaces smoothly with my MySQL database. The website already has formatting etc, so I'm not looking for that. The database stores a variety of exercise data, and the webpage needs to display this data in an intuitive and user-friendly manner. Key webpage features include: - Display of exercise data: Each exercise's description and its difficulty level should be displayed. There's also a column in the database containing YouTube URL links, so another important feature the webpage needs is the ability to watch these exercise videos directly from the webpage. It is a simple database with only one table. - Users should be able to select the exercise they wa...
I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.
...store experience, a keen eye for detail, and proficiency in spreadsheet management. You'll be tasked with: - Keyword Optimization: Adjust the product titles on my Wix store to ensure they are optimized for search engines. Experience with SEO would be beneficial for this. - Database Creation: Develop a comprehensive database for all my products. This will include attributes like Product names, Product prices, and Product URLs. - Formatting: The database should contain separate columns for each product attribute. Strong organizational skills and experience with data entry would be ideal. Ultimately, the goal is to streamline the management of my product listings for a smoother business operation. Prior experience with Wix and creating product...
...good understanding of Mechanical Engineering and Data Science to help me set up a database that records the live feed of on-board sensors in a car. Key Responsibilities: - Utilizing an On-Board Diagnostic Tool and an app to record the data - Implementing a database to store the collected sensor data - Analyzing the data primarily for predictive maintenance using statistical analysis Ideal Skills: - Mechanical Engineering background - Proficiency in working with On-Board Diagnostic Tools - Strong experience in statistical analysis - Knowledge of database management systems and data analysis tools - Experience in predictive maintenance is a plus This project requires attention to detail, analytical thinking, and the ability to tr...
I am searching fo...apply their knowledge towards data analysis, market research, and performance monitoring. Its a small assignment This assignment involves diving into a snowflake database to explore how customers behave. The goal is to find useful information that can help the Product team make decisions to make the business grow. After you uncover insights, you'll suggest changes to the product, like adding new features, making current features better, or even getting rid of features that aren't working well. You need to do the analysis, create graphs to show your findings, share all the code you used, and also come up with a plan for an A/B test to try out one of your suggested changes. Note: Its a short assignment, ...
I'm looking for an experienced server administrator to optimize my dedicated server running Almalinux 9.3 + Plesk. The server is currently performing poorly with slow website loading times and database slowdowns, which is unacceptable as I regularly have more than 500 concurrent visitors. The primary focus of this project will be optimizing the server's Plesk settings, Postgres and MariaDB databases, and PHP 8.2 configuration. Key tasks will include, but are not limited to: - Configuring Plesk for optimal performance, including adjusting server pool size - Identifying and implementing improvements to Postgres and MariaDB settings to reduce slowdowns - Tuning PHP 8.2 to enhance website speed and performance Ideal candidates for this p...
I am seeking a detail-oriented freelancer who can expertly transfer text data from PDF files into a database. The ideal candidate should possess the following skills and experience: - Proficiency in working with PDF files - Expertise in data entry tasks - Experience in formatting and structuring databases - Excellent attention to detail Suitable candidates need to handle copious amounts of text data, accurately convert the text-containing PDF files into a structured and organized database. This includes careful validation to ensure no data is lost or misrepresented during the data entry process.
Hi Ashish, this is for the tasks I emailed about.
We have a website where the homepage currently loads slowly due to multiple API calls. Despite implementing asynchronous API calls, the page load time is still not meeting our target. We are looking for a skilled developer to optimize the homepage to load within 1 second. we need some one who can : Optimized homepage that loads within 1 second. Cron job implementation for fetching and updating api data of tokens price/5%/24%//etc basically - i want to load data everything from DB only , rather than multiple api calls. thakns
I am looking for an expert Oracle DBA with experience in both Oracle RAC (Real Application Clusters) and standalone Oracle data...primary goal of this project is performance tuning. Ideal Skills and Experience: - Proven experience with Oracle RAC - Proven experience with standalone Oracle databases - Specialization in performance tuning - Familiarity with Oracle Database 19c Key Responsibilities: - Implementing performance tuning strategies - Monitoring and optimizing database performance - Troubleshooting issues related to performance - Ensuring the smooth operation of both RAC and standalone Oracle databases The ideal candidate should have a deep understanding of Oracle databases and be able to provide tailored solutions for enhancing performance on both Or...
...skilled developer who can build a customized matchmaking database for my internal use. The database will primarily focus on matching investors to investment opportunities. Key Features: - Storing Match Preferences: The database should be able to store various match preferences including minimum/maximum investment, minimum/maximum funding amount, geographical preference, and the type of funding. - User Authentication: As this database will be for internal use only, the user authentication should be secure and limited to specific staff members. No external user authentication is required. - Search Criteria: The database should have search functionality based on the geographic location. Ideal Skills: - Proficiency in dat...
I'm looking for an expert programmer proficient in Node, The bot was created to scrape coins from my Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functio...
I'm looking for an expert programmer proficient in Node, The bot was created to scrape coins from my Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functio...
I'm seeking a proficient individual for constructing an Access database for my project. The principal requirements include: - Experience with Access, as that's the selected database management system. - Expertise in data storage and retrieval is essential. - The database will be storing textual and numerical data. Experience in handling these types of data is crucial. Ideal skills would include an in-depth understanding of Access, database design, data storage/retrieval techniques and knowledge in handling both textual and numerical data. This should make for a streamlined and efficient process. I'm excited for us to kickstart this project together!
...will include a link to the company’s website. For example, when I search on Google for… Jake The Plumber Minneapolis, MN … I see a link to Jake The Plumber’s website. Your script(s) will not submit the forms; rather, I will review each form and then manually submit each myself. In other words, I will click on, for example, the “Send” or “Submit” button. If I were to loop your script(s) X times, then your script(s) would open X tabs in Google Chrome. Each tab would contain a website for a particular business. For example, if I were to loop your script(s) 89 times, then your script(s) would open 89 tabs in Google Chrome. Each tab would contain a website for a particular business. Most such websites I have v...
The database is on the National Environmental Agency's website, and it includes all of the applications submitted for environmental permits. Here is a link to the database: Please go over all of the records, and filter ones that match all criteria: 1. EIA Screening Application/Statement or EIA Scoping Application/Statement and 2. The application is for an activity in the sea Start a new spreadsheet, and for every such record, meeting the above criteria, add a row to the spreadsheet including: date of the record, screening/scoping, title of the application (translated to English), a url linking to the application on the NEA website. In addition, download the screening/scoping report document, translate it to English with Google trans...
We would like to hire a freelancer expert in development of Postgres Database and Synchronization of Data from our Headquarter to our Multiple Area Office (10 No.) and to Multiple Local PC (Around 300 Nos.) locations available in Network.
We have attached the details we need to sync our data from Headquarter to Area Office and than to local PCs and back again. for RFID based application.
i have a form created with HTML and PHP. user has to fill in information and when press submit, it should insert infos in database. But sometimes it doesn't it just clear or keep loading. maybe connection is not good everytime. So i need someone to adjust it to upload data in realtime. as soon as user finished typing in 1 field, it should store data. when uploading, it should show loading icon near input field. if succeed, green vink icon. if not, red cross icon. when user finish, user can click submit button which will echo all data stored in mysql database on same page in lightbox. image attached. Budget is $35. if you want more, please do NOT bid. budget is $35
I want to scrape daily leads from LinkedIn Jobs, Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference will be given to those who have previously performed lead extraction tasks for recruitment websites.
My WordPress site hosted on AWS is currently down due to a database connection issue. Key requirements: - **Database Connection Issue**: The site is throwing an 'Error establishing a database connection' message. I believe this is related to database connection details in the WordPress configuration file. If you are experienced with AWS and WordPress, this could be a quick fix. - **Backup Restoration**: I have a recent backup of the site. However, I'm not confident about the database connection details in the configuration file. Restoring the backup and ensuring the database connection works correctly is crucial. - **AWS and WordPress Expertise**: Ideal candidates should have experience with both AWS and WordPress. ...
Lütfen detayları görmek için Kaydolun ya da Giriş Yapın.
I'm in need of an expert who can help in developing a relational database using SQL and Python. The project will primarily revolve around database management. Consequently, I would appreciate assistance in the following tasks: - Designing a new relational database, ensuring it's optimized for efficiency and performance. - Implementing data import and export capabilities for seamless data movement. - Developing queries to support the database's functionality and ease of use. The ideal candidate for this project should have a strong background in both SQL and Python, with a specific focus on database development. Experience with optimizing databases for performance and some knowledge of data import/export mechanisms would be advantageous. M...
I'm in need of an expert who can fix my corrupted .FIC file in my HFSQL database. Key Project Requirements: - The file is currently not opening and is producing errors, so the main goal is to restore it to its original state and ensure it can be opened without any issues. Please note that I can provide the corrupted .FIC file for analysis. Ideal Skills and Experience: - Proficient in HFSQL database management. - Proven track record in repairing and recovering corrupted database files. - Strong problem-solving skills to identify and rectify the issues within the file. If you're confident in your ability to handle this task efficiently, please provide details of your relevant experience and how you plan to approach this ...
