230k XML data Files - any problem?


DevX Home    Today's Headlines   Articles Archive   Tip Bank   Forums   

Results 1 to 2 of 2

Thread: 230k XML data Files - any problem?

  1. #1
    brian Guest

    230k XML data Files - any problem?


    I have a really static (update 1/month) and very old IDMS Db that I am
    planning to dump and generate 230k files of XML each XML file will
    map to exactly one employee.

    Planning on using a servlets/jsp's to format the XML into HTML and/or
    PDF. The XML will also be used as a data source for a complementary
    servlet. I like this solution because of the static nature of the data,
    as well as the our load expectations of everyone wanting a look the
    first week and trailing off to very low load afterwards

    My only fear is the sheer volume of these employee files each filename
    contains the a primary key (employee number). Not sure of the hardware
    yet but probably OS/390 running Websphere 3.02 possibly Unix though.....

    Number of files a problem?

    Should I create the HTML dynamically or ahead of time? If I do it ahead
    I am storing 460k files because the data needs to be available to the
    complementary servlet in XML format......

    Appreciate any help.......
















  2. #2
    Sylvia Vargas Guest

    Re: 230k XML data Files - any problem?


    If you data is static, create the files only when the data changes (if ever).
    If your data is more dynamic, then create JSPs to access files.

    My data rule of thumb, treat like alike.

    "brian" <brian.simard@cgi.ca> wrote:
    >
    >I have a really static (update 1/month) and very old IDMS Db that I am
    >planning to dump and generate 230k files of XML each XML file will
    >map to exactly one employee.
    >
    >Planning on using a servlets/jsp's to format the XML into HTML and/or
    >PDF. The XML will also be used as a data source for a complementary
    >servlet. I like this solution because of the static nature of the data,
    >as well as the our load expectations of everyone wanting a look the
    >first week and trailing off to very low load afterwards
    >
    >My only fear is the sheer volume of these employee files each filename
    >contains the a primary key (employee number). Not sure of the hardware
    >yet but probably OS/390 running Websphere 3.02 possibly Unix though.....
    >
    >Number of files a problem?
    >
    >Should I create the HTML dynamically or ahead of time? If I do it ahead
    >I am storing 460k files because the data needs to be available to the
    >complementary servlet in XML format......
    >
    >Appreciate any help.......
    >
    >
    >
    >
    >
    >
    >
    >
    >
    >
    >
    >
    >
    >
    >



Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
HTML5 Development Center
 
 
FAQ
Latest Articles
Java
.NET
XML
Database
Enterprise
Questions? Contact us.
C++
Web Development
Wireless
Latest Tips
Open Source


   Development Centers

   -- Android Development Center
   -- Cloud Development Project Center
   -- HTML5 Development Center
   -- Windows Mobile Development Center