DevX Home    Today's Headlines   Articles Archive   Tip Bank   Forums   

Results 1 to 5 of 5

Thread: Web Crawler in C++

  1. #1
    Join Date
    Oct 2007

    Exclamation Web Crawler in C++

    Hi All,
    I wanted to write a Web Crawler in C++, without using in external TOOL.
    I wanted to know more abt the web programming / HTML /HTTP / TCP / UDP programming.

    My crawler will work like this :
    1. Gets the URL
    2. GO to that url and fetch all pages and links from that site, sotre in .csv file and use this information for reporting.
    3. Separates the keyword search in that crawled pages and store it in new file.
    4. Find all URL based on my search keyword and update the report.

    It is based on GUI. I know complete desgin of my UI, but wanted to start the web programming in C or C++. just help me which library to use how to program, just i wanted some start up tips after that I will go ahead with all of urs help.

    Its a open source project.
    Please help me.
    Thanks in Advance.

  2. #2
    Join Date
    Apr 2007
    Sterling Heights, Michigan
    Why C++ rather than C#?

  3. #3
    Join Date
    Oct 2007
    No, Its my project demand that I have to it in C++ only either VC++ or GCC any one but on windows only.

  4. #4
    Join Date
    Jan 2007
    Use some http library search in

  5. #5
    Join Date
    Oct 2005

    I have open source project you can use

Similar Threads

  1. Replies: 0
    Last Post: 03-31-2007, 08:40 AM
  2. Using Java 6SE to query a web service
    By (MC3)RaVeN in forum Java
    Replies: 0
    Last Post: 03-02-2007, 10:30 AM
  3. Re: Why REST is a better way to do Web Services
    By Michael D. Kersey in forum .NET
    Replies: 2
    Last Post: 08-30-2002, 12:05 AM
  4. Free ASP.NET Web Matrix Design/Editor Tool Released
    By ASPSmith Training in forum dotnet.announcements
    Replies: 0
    Last Post: 06-18-2002, 03:39 AM
  5. Replies: 0
    Last Post: 04-19-2001, 07:54 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
HTML5 Development Center
Latest Articles
Questions? Contact us.
Web Development
Latest Tips
Open Source

   Development Centers

   -- Android Development Center
   -- Cloud Development Project Center
   -- HTML5 Development Center
   -- Windows Mobile Development Center