DevX Home    Today's Headlines   Articles Archive   Tip Bank   Forums   

Results 1 to 5 of 5

Thread: Web Crawler in C++

  1. #1
    Join Date
    Oct 2007
    Posts
    1

    Exclamation Web Crawler in C++

    Hi All,
    I wanted to write a Web Crawler in C++, without using in external TOOL.
    I wanted to know more abt the web programming / HTML /HTTP / TCP / UDP programming.

    My crawler will work like this :
    1. Gets the URL
    2. GO to that url and fetch all pages and links from that site, sotre in .csv file and use this information for reporting.
    3. Separates the keyword search in that crawled pages and store it in new file.
    4. Find all URL based on my search keyword and update the report.

    It is based on GUI. I know complete desgin of my UI, but wanted to start the web programming in C or C++. just help me which library to use how to program, just i wanted some start up tips after that I will go ahead with all of urs help.

    Its a open source project.
    Please help me.
    Thanks in Advance.

  2. #2
    Join Date
    Apr 2007
    Location
    Sterling Heights, Michigan
    Posts
    8,663
    Why C++ rather than C#?

  3. #3
    Join Date
    Oct 2007
    Posts
    1
    No, Its my project demand that I have to it in C++ only either VC++ or GCC any one but on windows only.

  4. #4
    Join Date
    Jan 2007
    Posts
    145
    Use some http library search in sourceforge.net

  5. #5
    Join Date
    Oct 2005
    Posts
    6

    I have open source project you can use


Similar Threads

  1. Replies: 0
    Last Post: 03-31-2007, 08:40 AM
  2. Using Java 6SE to query a web service
    By (MC3)RaVeN in forum Java
    Replies: 0
    Last Post: 03-02-2007, 10:30 AM
  3. Re: Why REST is a better way to do Web Services
    By Michael D. Kersey in forum .NET
    Replies: 2
    Last Post: 08-30-2002, 12:05 AM
  4. Free ASP.NET Web Matrix Design/Editor Tool Released
    By ASPSmith Training in forum dotnet.announcements
    Replies: 0
    Last Post: 06-18-2002, 03:39 AM
  5. Replies: 0
    Last Post: 04-19-2001, 07:54 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center
 
 
FAQ
Latest Articles
Java
.NET
XML
Database
Enterprise
Questions? Contact us.
C++
Web Development
Wireless
Latest Tips
Open Source


   Development Centers

   -- Android Development Center
   -- Cloud Development Project Center
   -- HTML5 Development Center
   -- Windows Mobile Development Center