Post a Reply

Database size

  1. 6 years ago

    J-Hinckley

    22 Oct 2016

    Hi everyone,

    I am starting to get quite a bit of data in the PIM now (well, quite a bit to me) and plan to add a lot of data all over the Christmas holidays etc.

    Chris (writer of doogiePIM) tells me the database is based on a proprietary system compatible with a SQL-92 database engine (although I'd like to know more about the database engine).

    However, I have no experience with database size.

    Does anyone have a really large database and can share their experiences on size and speed?

    If the database is the same as it was for do-organiser / Harmony, can anyone shed any light on the size of their databases?

    Over time, I will add a lot of data to the PIM, so would like to know it is going to be able to handle it in a safe manner.

    Any advice would be welcome.

    Many thanks.

    John

  2. 5 years ago

    Chris

    13 Feb 2018 Developer, Moderator, Test Pilot
    Edited 5 years ago by Chris

    This one was left unanswered so here goes:

    Warning: Geek Speak ahead!

    Database, Encryption and Size

    The database system used is a SQL-92 compatible proprietary structured build. You are able to use SQL commands to extract data.

    More here:
    https://bitespire.com/help/?Advanced%20(SQL)%20Search%20and%20Query.html

    A SQL command summary can be found here:
    https://bitespire.com/help/?SQL%20Reference.html

    Specifications can be found in the Help documentation:
    https://bitespire.com/help/?Database%20File%20Specifications.html

    This basically means you can add a lot of data. The file size of the database should grow to a practical maximum of about 3GB to 4GB. However, it can go larger but backups and indexing will take much longer. Records such as documents and comments are internally packed using compression then each record block is encrypted using the chosen encryption method. This makes the database compact.

    I have databases that are 12GB, 6.5GB and 1.5GB. Each contain a variety of records. The 12GB file contains mostly Documents with many images. The 1.5GB file is my daily use email, tasks, documents etc.

    To summarise; Keep it small for faster backups for daily use but if you just want to store a bunch of stuff to file away, then load it up.

    I hope others will write in and tell of their experiences and file sizes too. It would be great to gauge if this area needs development or not.

    As always, many thanks for the wonderful emails and messages on doogiePIM.
    Chris.

  3. J-Hinckley

    15 Mar 2018

    Hi Chris, does the above still stand for v2?
    I take it the database has remained unchanged from v1 to v2?

    Thanks
    John

  4. Chris

    16 Mar 2018 Developer, Moderator, Test Pilot

    @J-Hinckley Hi Chris, does the above still stand for v2?
    I take it the database has remained unchanged from v1 to v2?

    Yes, the specifications in the above post are for version 1 and version 2. The latest databases schedule in v2 has encryption changes to improve security as well as some field data changes. Therefore, Version 1 database will open in version 2 but version 2 databases won't open in version 1.

    This ensures that old backup files open correctly, with the latest doogiePIM.

    If you plan to go back to version 1 then always open databases in version 2 with a COPY of your database. This is because once converted in v2 you can't use doogiePIM v1 to open it. This is by design.

    I hope this has answered your question.

    Chris

  5. J-Hinckley

    16 Mar 2018

    Thanks Chris

  6. 4 years ago
    H

    HJB

    16 Jul 2019

    Is there a more clear explanation of database and database size, as used in this application? Is each segment a different database or are all combined to determine how much space is being used? If I have 50,000 documents, is the entirety of each document included in database size, or is it just certain features of each document, such as title, etc.?

  7. BiteSpire

    16 Jul 2019 Administrator

    @HJB Is there a more clear explanation of database and database size, as used in this application? Is each segment a different database or are all combined to determine how much space is being used? If I have 50,000 documents, is the entirety of each document included in database size, or is it just certain features of each document, such as title, etc.?

    The database is a single file and all data is held inside that single file. If you had folders of documents, contacts, tasks etc, they are all inside that single database file. There are exceptions for when you link a PDF to a record. The PDF isn't stored in the database only the file name and the link. This is to ensure the database doesn't get too bloated.

    I hope this helps:
    https://bitespire.com/help?Introduction%20to%20Database%20Files.html

 

or Sign Up to reply!
  • BiteSpire on Twitter  BiteSpire on YouTube  Linkedin

  • doogie®PIM   ·   purchasing  ·  downloads  ·  help  ·  support  ·  privacy  ·  terms  ·  contact

     
    © BITESPIRE®. All rights reserved.
     
    BITESPIRE® and BITESPIRE®RESEARCH are trading names of BiteSpire Ltd, a private limited company registered in England and Wales
    East Holcombe Annexe, Shillingford, Devon, EX16 9BR, United Kingdom, Planet Earth
    (Turn left at Proxima Centauri for about 4.2 light-years. You can't miss it. Just follow the smell of CO2)
     
    VAT GB366206009 | Company number 11208675 | ICO Data Protection ZA916546