DevX Home    Today's Headlines   Articles Archive   Tip Bank   Forums   

Results 1 to 2 of 2

Thread: Processing XML

  1. #1
    Join Date
    May 2004
    Posts
    242

    Processing XML

    Hello,

    I have an C++ on Unix that needs to get name and attribute from an XML. I'm currently using xerces. As I traverse through the XML, I'm populating a std::map which later will have things like :-
    ...
    myMap["Name"] = "Ami"
    myMap["Age"] = "..."
    ...

    When I have a very long XML, e.g. 1000 elements, then it takes approx 2 seconds to process it and populate the map.

    Does anyone have any ideas how to process this quicker ? Is xerces not too old ? When I tried seaching for the values by looking for '<', '/>', etc. it takes just as long or sometimes quicker than xerces.

    How come I'm hearing people say that they process 10,000 massive XMLs in 1 second ?

    Can someone please help ? I'm working on Unix and I don't have a schema or DTD.

    Thanks.

  2. #2
    Join Date
    Dec 2003
    Posts
    3,366
    I really dislike XML, its extremely bloated at the best of times. Portability is nice but taking up 10X the space for data is not so nice.

    You could try to multi-thread the search, divide and conquor the file if you have multiple CPUs on the system.

    Other than that, how exactly are you searching it and what sort of data structure is it in? If you read the file into a pointer/array of bytes, and search it byte by byte in a loop, thats about as fast as you can get since the data is not sorted or organized in any way that you can attack. If you read the whole thing into a string or vector or other complicated container, depending on the implementation, those can slow things down, or speed them up, it varies from package to package a lot. The search algorithms in the STL may or may not be faster than what you can do. I suspect they are slower than a basic loop.

    Anyway, thats my take on it... drop it in a POD container, loop fast, thread. If you can beat that with some other method, share with me, please! It is unlikely that a 5 line assembly search to do the same would be any better for so basic an approach.
    Last edited by jonnin; 07-24-2011 at 07:46 AM.

Similar Threads

  1. Try XML Junction
    By Tim in forum xml.announcements
    Replies: 0
    Last Post: 10-11-2001, 04:00 PM
  2. XML Startkabel Updates
    By xmlstartkabel in forum XML
    Replies: 0
    Last Post: 10-10-2001, 04:07 AM
  3. Data Junction Announces XML Junction 7.51
    By Tim Frost in forum xml.announcements
    Replies: 0
    Last Post: 04-02-2001, 10:53 AM
  4. Check out Turbo XML: Free trial download
    By Extensibility in forum web.announcements
    Replies: 0
    Last Post: 07-20-2000, 06:20 PM
  5. Check out Turbo XML
    By Sales in forum xml.announcements
    Replies: 0
    Last Post: 07-20-2000, 06:18 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center
 
 
FAQ
Latest Articles
Java
.NET
XML
Database
Enterprise
Questions? Contact us.
C++
Web Development
Wireless
Latest Tips
Open Source


   Development Centers

   -- Android Development Center
   -- Cloud Development Project Center
   -- HTML5 Development Center
   -- Windows Mobile Development Center