Help Needed: Developing a Search Engine in Java


DevX Home    Today's Headlines   Articles Archive   Tip Bank   Forums   

Results 1 to 10 of 10

Thread: Help Needed: Developing a Search Engine in Java

  1. #1
    Join Date
    Sep 2005
    Location
    india
    Posts
    5

    Cool Help Needed: Developing a Search Engine in Java

    Hi
    i want to develop a search engine in java. Could somebody help me?

  2. #2
    Join Date
    Mar 2004
    Posts
    635
    help you with what exactly? be more specific.

  3. #3
    Join Date
    Nov 2004
    Location
    Norway
    Posts
    1,560
    I have some code that searches locally stored web pages (like the jacva doc),
    it can easily be modified to do web search as it now only accepts url's that start
    with "file:". I utilzes a BigBuffer class to harness the memory usage during multiple
    threaded text scan and it is not a beginners type of app, but if you want to have a
    look I can zip and post it here.
    eschew obfuscation

  4. #4
    Join Date
    Aug 2005
    Posts
    43
    Quote Originally Posted by sjalle
    I have some code that searches locally stored web pages (like the jacva doc),
    it can easily be modified to do web search as it now only accepts url's that start
    with "file:". I utilzes a BigBuffer class to harness the memory usage during multiple
    threaded text scan and it is not a beginners type of app, but if you want to have a
    look I can zip and post it here.
    I'm interested in looking at a code that does that, not that I wanna do a search engine myself, but just to learn...can you post the zip file? Thanks.

  5. #5
    Join Date
    Nov 2004
    Location
    Norway
    Posts
    1,560

    Here it is.

    It has some 29 classes and is basically a pre-beta version. It compiles and
    runs ok, but some processing options are visible but not implemented
    yet and should be regarded as suggested/intended additions to the program.

    However, it utilizes many classes for HTML parsing and processing.

    If you find something that is totally wrong then please let me know.
    Attached Files Attached Files
    eschew obfuscation

  6. #6
    Join Date
    Sep 2005
    Location
    india
    Posts
    5
    i have decided to develope a engine,which will be having a user interface (developed using jsp)and based on the matching of keyword entered by user .It will be displaying the sites to user.but the problem is how to match the keywords & how the dynamic display of sites can be done. will there be any need to learn spider programming.will it be searching the meta tags in sites. I will be waiting for ur reply.

  7. #7
    Join Date
    Sep 2005
    Location
    india
    Posts
    5
    I Would Like To Give A Look At The Code. It Might Be Possible That It Would Be Helpful. Thank You

  8. #8
    Join Date
    Sep 2005
    Location
    india
    Posts
    5
    Thanx Sjalle
    I Would Like To Give A Look At The Code. It Might Be Possible That It Would Be Helpful. Thank You

  9. #9
    Join Date
    Nov 2004
    Location
    Norway
    Posts
    1,560
    You should have a look at the WScanner and the WScanFilter, it does the whole job
    of extracting tags and page contents, eg, all links found in a webPabe are returned as
    a NameValArray (an arraylist & hashtable hybrid) with mapping like linktext->url.

    It uses the setup provided by the HTMLEditorKit.Parser and HTMLEditorKit.ParserCallback classes from the
    javax.swing.text.html package.

    Good luck !
    eschew obfuscation

  10. #10
    Join Date
    Sep 2005
    Location
    Dr. meciano Road
    Posts
    1

    Post Asking for a favor

    Our instructor told us to research some game programs with codes that we are to modify and develop these programs...because of this we can also post here later if anyone could give these programs.

Similar Threads

  1. Replies: 2
    Last Post: 06-14-2006, 04:16 PM
  2. Replies: 2
    Last Post: 09-08-2005, 07:38 AM
  3. Beef up that search engine!
    By Larry Serflaten in forum Talk to the Editors
    Replies: 3
    Last Post: 07-16-2001, 03:30 AM
  4. Replies: 0
    Last Post: 06-17-2001, 10:07 AM
  5. DevX Search Engine not working on DOTNET stuff
    By Robert Scoble in forum Talk to the Editors
    Replies: 2
    Last Post: 11-25-2000, 04:21 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center
 
 
FAQ
Latest Articles
Java
.NET
XML
Database
Enterprise
Questions? Contact us.
C++
Web Development
Wireless
Latest Tips
Open Source


   Development Centers

   -- Android Development Center
   -- Cloud Development Project Center
   -- HTML5 Development Center
   -- Windows Mobile Development Center