Completado

URL Extractors with Domain identification

I would like to have a Java, Mac Shell Script or Perl Script application, which:

1: Take two input files, 1st input file with a set of URL, the other input file with a set of mapping of domain name and nickname.

2: In each of the input URL, extract the web page and the URL(s) inside the web page.

3: Identify if any extracted URL matches with the domain name from the 2nd input files.

4: Once a domain is identified, print an output line with the input URL and the tracked domain.

5: Next URL from the 1st input file.

6: At the end of the program, print out a count summary of all identified domain.

# Notes:

- Steps 2 may required further deep dive of all URLs extracted. Configurable parameter required.

- Multi-thread is required so multiple site scanning could be done. configurable parameter is required.

#Sample 1st input file.

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

#Sample 2nd input file.

[url removed, login to view] Google

[url removed, login to view] Yahoo!

[url removed, login to view] Facebook

#Sample output

[url removed, login to view] Google

[url removed, login to view] Facebook

[url removed, login to view] Facebook

[url removed, login to view] Facebook

[url removed, login to view] Google

[url removed, login to view] Google

[url removed, login to view] Yahoo!

Google 3

Facebook 3

Yahoo! 1

Habilidades: PHP, Arquitectura de software

Ver más: yahoo hk, yahoo com freelancer, www freelancer web page, www freelancer org in, www freelancer in facebook, www freelancer hk 3, www freelancer com with, www freelancer 24 com, web freelancer in hk, web freelancer hk, url www freelancer com, url of freelancer, perl web freelancer, kickstarter freelancer, java script freelancer, freelancer with google, freelancer with cnn, freelancer summary software, freelancer mapping, freelancer kickstarter

Información del empleador:
( 4 comentarios ) Singapore, Hong Kong

Nº del proyecto: #6499309

Adjudicado a:

honghas

Hi! I am doing same project like this so I am very much interested in your project. Please contact me!

$300 USD en 10 días
(0 comentarios)
0.0

12 freelancers están ofertando el promedio de $679 para este trabajo

A2Design

Hello, If you’re looking for a passion-driven team of reliable young professionals, we are glad to help! We can build URL Extractors for you. Shall we arrange a telephone or a Skype call? Here's my skype: A2d Más

$800 USD en 10 días
(47 comentarios)
8.0
SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of my similar experience: Amazon/Ebay Bots: [login to view URL] Más

$526 USD en 10 días
(258 comentarios)
8.0
seekdeveloper

Hi, I have read your post and understood your requirement. I have good experience in handling Wordpress /Magento/Joomla/Drupal/ HTML5/CSS3/PHP/ Yii framework/Javascript/MySQL/ Kindly go through my works to c Más

$1052 USD en 10 días
(61 comentarios)
7.6
expatdev

Hi, I'd like to work on your project. I can provide a robust and efficient implementation in Perl on Java, tested in a Mac environment. My suggestion would definitely be to use Perl. Perl is an excellent match for the Más

$475 USD en 3 días
(114 comentarios)
7.0
hexamilesoft

WHOA! Hey there, My name is Faisal Malik and I’m the lead developer of Hexamilesoft Company. We are the web development and social media/SEO/SMO/SEM professionals and having more than 12 year experience along with r Más

$555 USD en 10 días
(90 comentarios)
6.3
Batista111

Hi, I have more than Three year of experience. so we can do your project easily but Please come on chat for further discussion. Benefits u get: 1. 2 Months Free Tech Support 2. W3C Compliant Code, So Pages L Más

$388 USD en 10 días
(46 comentarios)
5.7
KeepTummypTummy

Hello, Thanks for giving me chance to bid on your task and taking a minute to read my profile brief.I have read this and i assured you 100% completion and best quality in reasoanble price. My expertise in web de Más

$480 USD en 10 días
(21 comentarios)
5.0
ongraph

Hi, I have reviewed in detail all the information that has been made available by you in posting and basis the same I am excited to confirm that I would be much interested in making available my services for the pro Más

$1052 USD en 15 días
(1 comentario)
5.0
joeguo

Hello, I have done several similar projects before, please refer my profile for more details. I can help to build it with Java/golang/python etc. Best Regards, Joe

$444 USD en 5 días
(8 comentarios)
4.6
bonapps

Hi, I have been through your requirements and it matches our expertise. I am very much interested in working on your project as it seems that we have done something similar. I am not yet confirmed that i will hav Más

$1500 USD en 20 días
(5 comentarios)
3.6
glontbay

Hello, Hope you had a great day today. I know you are looking for I.T. Programming partners to work on your projects. I will not tell you that we can do this and that; alternatively I would like to find the solut Más

$1500 USD en 30 días
(3 comentarios)
3.4
khongminhphong

Dear Sir. I'll do your request with Java. We have an API with can proccess the URL. I can delivery this one within 5 day.

$444 USD en 3 días
(11 comentarios)
2.8
ProFTP

Skills: PERL (MVC Catalyst), jquery (javascript), Ruby ​​(Ruby on Ralis), html/css, git, sql (mysql, pgsql), php, freebsd/linux Experience of more than 6 years of Perl + jQuery + FreeBSD Junior Ruby (Ruby on Ralis), in Más

$749 USD en 23 días
(0 comentarios)
0.0
danielkasak

This is a very simple task, and I'm a Perl guru. I can give you a WELL DOCUMENTED and ROBUST script to achieve this task and also teach you how it works if you like. I have multiple open-source projects on cpan ( searc Más

$250 USD en 2 días
(0 comentarios)
0.0