Kapalı

Make program in python for plagiatrizm detection

Plagiarism detection - NEED IT IN 5 days TOPS!

Find common phrases and sentences between documents (source and suspicious). Find all plagiarized parts. There can be 4 cases:

- Copy paste

- Copy paste + word order change

- Copy paste + paraphrasing

- Copy paste + word order change and paraphrasing

I suggest here using multithreaded Needleman Wunch algorithm for document similarity comparison and plWordnet for synonyms and paraphrasing checks.

Input file

There are sets of document pairs suspected to be plagiarized and files that previous have been plagiarized from. In plain text format named as [url removed, login to view], [url removed, login to view], where XXXX in pair number, in first there is something plagiarized from the second one.

Output file

In plagiarism was detected we want to save all information in XML file as follows:

<?xml version="1.0" encoding="UTF-8"?>

<alignment document="[url removed, login to view]" source="[url removed, login to view]">

<passage documentFrom="123" documentTo="123" sourceFrom="123" sourceTo="123" />

<passage documentFrom="234" documentTo="234" sourceFrom="234" sourceTo="234" />

</alignment>

Tag passage means that plagiarism was detected:

• documentFrom – beginning index of recognized plagiarized fragment from [url removed, login to view]

• documentTo- ending index of recognized plagiarized fragment from [url removed, login to view],

• sourceFrom- beginning index of recognized plagiarized fragment from [url removed, login to view],

• sourceTo- ending index of recognized plagiarized fragment from [url removed, login to view] m.

save all to suspiciousXXXX-sourceXXXX.xml. For entire task, it will be a set of XML files.

Measures

In order to measure quality, I will use

• precision,: Claude, Webb, Geoffrey I., “Encyclopedia of Machine Learning and Data Mining Sammut”, 2017, precision

• recall: Claude, Webb, Geoffrey I., “Encyclopedia of Machine Learning and Data Mining Sammut”, 2017, precision and recall

• granularity,: Potthast, Martin, et al. “An evaluation framework for plagiarism detection.” Proceedings of the 23rd international conference on computational linguistics: Posters. Association for Computational Linguistics, 2010.

• pladget score (main score),: Potthast, Martin, et al. “An evaluation framework for plagiarism detection.” Proceedings of the 23rd international conference on computational linguistics: Posters. Association for Computational Linguistics, 2010.

Trial set

Trial set is attahed:

• pl/en – division between PL and EN documents,

• src (inside pl/en) – source documents,

• susp (inside pl/en) – suspicious documents,

• xml (inside pl/en) – proper answers.

Evaluation tool

Is attached as JAR file that needs newest Java 8.

Arguments:

• -e evaluation method,

• -i path to ZIP file with reesulting XML files,

• -t path to folder with answers.

Example:

java -jar [url removed, login to view] -i c:\\[url removed, login to view] -t c:\\dataset -e TASK1

Baseline

THE BASELINE SLUTION TO THIS TASK in general can be based on suffix array. To find Longest Common Substring between documents.

In pre processing this documents will be:

• Remove special characters,

• Normalize white symbols in text,

• Remove EN stop-words,

• Remove PL stop-words,

Such data is then divided in 15-grams phrases and put into suffix array. The result of this is as follows:

• precision: 0.861901, recall 0.123821, granularity: 1.352459, plagdet: 0.175451

Nong, Ge, Sen Zhang, and Wai Hong Chan. “Linear suffix array construction by almost pure induced-sorting.” Data Compression Conference, 2009. DCC’09.. IEEE, 2009.


A was currently studying this topic a lot and I think that the tool would work best if worked in accordance to:
1. split text into sentences - for this I got such tool https://mega.nz/#!Y1V3mK4S!FChLKqtWfKM_Ezs4cpKbrvWI5O982cfZZ7dmOFPlqDE
2. pre-process text using https://mega.nz/#!t5liXD6T!MhC5wzqg-BZ-XWfAWWwuFu_w5Wy3DGyOGMhUTzAWDAE
3. lowercase all
4. for each sentence do LSA (Latent Semantic Anaysis) using - https://mega.nz/#!t4cAiB6I!aTPOQrvW5jbHrmZzbpfdE6WyL-8tS5D-RrD5hisvPAg
So we need to do train and testMP.py from this archive - best would be to have option to use LSA or wordnet as a parameter - it might be slow because it will generate for each sentence a lot of other sentences
5. compare each original sentence to all generated sentences from suspicious file. By doing this sentence by sentence we will maintain information which sentence was plagiarized. I suggest here using Needleman-wunch algorithms - best would be multithreaded version
6. save results in XML as previously described

Beceriler: C Programlama, C++ Programlama, Linux, Perl, Python

Daha fazlasını görün: program make hack combat arms update, program make free black nickname, program make csheats cs , program make bot mmorpg, program make alarm clock, load program make correct coloured nick, edge detection image processing program, bluej java program make game, python program play craps, interface python program reads csv outputs csv, python program checks validity numbers, python program craps, python program extract info website, help writing python program enter payroll information

İşveren Hakkında:
( 141 değerlendirme ) Czestochowa, Poland

Proje NO: #14396607

20 freelancer bu iş için ortalamada 613$ teklif veriyor

hbxfnzwpf

I am very proficient in c and c++. I have 16 years c++ developing experience now, and have worked for more than 7 years. My work is online game developing, and mainly focus on server side, using c++ under Linux environ Daha fazlası

in 5 gün içinde300$ USD
(121 Değerlendirme)
6.9
bestit4u

Hi I have read your job details. I have worked on the job similar to this job. Also I have a lot of experience in web development, web scraping & crawling, reverse engineering and programming like c++, python, java Daha fazlası

in 10 gün içinde555$ USD
(33 Değerlendirme)
5.7
masterlancer999

Hi I read your project description and found u are looking for me I already worked plagiarism project for faculty of university to analysis python code My prev project has following features -upload python files and Daha fazlası

in 10 gün içinde700$ USD
(16 Değerlendirme)
5.8
iitmshanker

I have 4 years of working experience in machine learning, natural language processing, ai , computer vision. Few projects done on freelancer: 0. Tweet classifier for threat detection. Used nltk, semantic analysis an Daha fazlası

in 4 gün içinde600$ USD
(17 Değerlendirme)
4.9
i8solutions

A proposal has not yet been provided

in 3 gün içinde833$ USD
(4 Değerlendirme)
5.0
zkutch

Hello More 20 years programming experience. I would like to discuss some details to set real price and time. Regards. ------------------------------------------------------------------------------------------------ Daha fazlası

in 10 gün içinde555$ USD
(35 Değerlendirme)
5.1
snippetbucket

Hello, We best suitable for your projects. * Excellent with English. * Excellent with Python & Related Frameworks * Excellent with Product Development * Excellent with Javascript CSS, Front-End * Ex Daha fazlası

in 15 gün içinde700$ USD
(21 Değerlendirme)
4.8
ShiaFirst

Hello, This project is quite easy for me, but I got couple of questions to clear before we proceed [url removed, login to view] message me to have a quick chat.

in 10 gün içinde750$ USD
(8 Değerlendirme)
4.7
BeautiCG

Hi,dear. I am a senior software developer. I have just checked your project report, I am able to perform this task with my developer team. I am looking forward to your proposal...

in 2 gün içinde555$ USD
(17 Değerlendirme)
4.6
in 5 gün içinde736$ USD
(6 Değerlendirme)
4.2
MetaoriginLab

Me and my team has 5 years of experience into Python/Django,iFrame/flask/Golang & Data Scraping or Web Crawling. Can very well execute this Project and can work at US hours.

in 10 gün içinde888$ USD
(6 Değerlendirme)
2.9
in 5 gün içinde555$ USD
(3 Değerlendirme)
2.2
ITSupersoft

Supersoft ITSolutions is registered with Ministry of Corporate affairs New Delhi, India and operates from office situated in Noida (National Capital Region). It was established in the year 2015. We follow agile methodo Daha fazlası

in 10 gün içinde511$ USD
(0 Değerlendirme)
0.0
seankahn

Hi! Sounds like you need an AI / Neural Network to determine a similarity score. I can deliver you the result in 3 days, if you give the project to [url removed, login to view] us discuss the details on Chat. Thank you.

in 3 gün içinde444$ USD
(0 Değerlendirme)
0.0
ishtiyaqahmad

Hello My name is Ishtiyaq, I am certified python expert I have 4 years+ experience in python language and I have completed 100+ projects using python .. Expertise : Python, Django, Django-Rest- Framework and many pyt Daha fazlası

in 10 gün içinde250$ USD
(0 Değerlendirme)
0.0
dimitrovworkin

Hello! I have much experience in Python programming and i already worked with similar project. Lets contact for details!

in 5 gün içinde500$ USD
(0 Değerlendirme)
0.0
lawSamuels

5 days tops. We're looking at $1000 for the speed required and the complexity of this task. My final year university project was building something very similar to this.

in 5 gün içinde1000$ USD
(0 Değerlendirme)
0.0
workspaceitaus

Hello, I am Tahsinul Alam, completed Masters in Software Engineering now working as one of the project manager in Python team of Workspace Infotech Ltd, software/Outsourcing firm located in Melbourne, Austrlia. We Daha fazlası

in 10 gün içinde555$ USD
(0 Değerlendirme)
0.0
srvmediaindia

Hello, Well, to brief you about me - I am a professional with 8 years of development experience and have delivered into lot of similar projects. We have designed and developed various websites in different domains. We Daha fazlası

in 20 gün içinde666$ USD
(0 Değerlendirme)
0.0
HR000

Supersoft ITSolutions is registered with Ministry of Corporate affairs New Delhi, India and operates from office situated in Noida (National Capital Region). It was established in the year 2015. We follow agile methodo Daha fazlası

in 10 gün içinde616$ USD
(0 Değerlendirme)
0.0