Fossil Forum

Importing large git codebases (NetBSD), a summary
Login

Importing large git codebases (NetBSD), a summary

Importing large git codebases (NetBSD), a summary

(1) By anonymous on 2024-04-13 11:02:07 [link] [source]

Hi all,

I just want to write about my experience playing around with the import of git repos into fossil ones. I learned that NetBSD maintains a semi-official repository conversion for Fossil. It has several repos, the main one being its own src repo. NetBSD has had a long commit history and it is a fairly big repo. Their Fossil mirror takes a while to load, so be patient. Their repo uses fossil 2.20. I used fossil 2.23 for this process.

I used its git mirror and I tried to export it to Fossil for the fun of it. Their git repo, after doing a simple git clone, weights 6.3G (found using du -sh . in the root directory) and has about 305_700 commits (found using Github's commit number). I then proceeded to export it to Fossil using the documented method git fast-export --all | fossil import --git new-repo.fossil.

The entire import process took about 3 and a half days. When I say "about" is that I did not properly benchmark/measure the time it took. I started the process on a Tuesday afternoon and it was done on Saturday's morning. The import process, which outputs the dates that are being imported (I assume the dates represent commit dates), was not monotonically increasing. What I mean is that the dates did not keep increasing from the earliest commits to the new ones. In the case of NetBSD that would be from about 1993 to 2024. Instead, the imported dates increased, then they suddenly went back a few months/years back and started to increase once again. I assume that this behaviour is from git fast-export and when the dates go back in time it is probably that git is exporting a branch, so it goes back in its history and exports it. After that very long export process, then Fossil started rebuilding the repository metadata and vacuuming. This process also took a while, but I am usure how much (maybe a day?). The final result is a 7.4GB fossil file :)

Relative to resource utilisation, Fossil was using 100% of a single CPU core constantly. I am using a 7840HS AMD CPU (laptop), and the CPU frequency was between 4600 and 4900 MHz the entire process. The git process was using also a single CPU but at much lower utilisation rates (maybe 20%?). I have 32GB DDR5 RAM, and I did not see it getting filled, so that is good, but I do not remember how much each process used. What I did notice is the large utilisation of storage. I have no hard numbers here, but I believe the process used around 40GB of storage during the process, as I saw my available storage drop from about 80GB to 30GB and then go back to 70GB (I was also not doing anything else that required storage).

All and all, that was quite a journey. I expected the process to be much faster, but I am happy to see that it is doable with a fairly fast CPU, as it seems the entire process is CPU bound. Maybe if I had compiled Fossil natively for my CPU (which supports up-to AVX512 instructions), the process could have been sped up a few percentage points, which would have saved a few hours.

I am writing this post as a means to document my journey and as an anecdote to others. I am a happy Fossil user and I just like pushing technology to its limits. Also, as you may have noticed, I am not a very knowledgeable user, so take my experience as that of a newbie.

Thank you to everybody that builds and improves Fossil!

Best regards,

Fer

(2) By Stephan Beal (stephan) on 2024-04-13 11:15:22 in reply to 1 [link] [source]

NetBSD has had a long commit history and it is a fairly big repo.

It's the largest known repo, but it's also a pathological case for fossil's data model, which does not scale too nicely for repositories with that many files. Fossil doesn't have any significant performance problems with high commit counts, but performance and memory cost of its check-in records scale linearly with the number of files in the check-in. The last time i checked (more than a year ago) each check-in record for that repo was approximately 7MB, whereas the check-in manifests for fossil's own repository are currently 82kb, more than 99% of which is the list of files.

What I did notice is the large utilisation of storage.

Probably caused by sqlite's journaling.

(8) By Warren Young (wyoung) on 2024-04-14 00:55:53 in reply to 2 [link] [source]

Thus the option of delta manifests.

Alas that there is no “fossil git import --delta” flag to make it try to produce DMs from the root up, as that would resolve the uncertainty in that doc as to whether delta compression of manifests suffices.

(9) By Stephan Beal (stephan) on 2024-04-14 01:18:20 in reply to 8 [link] [source]

Thus the option of delta manifests.

Which don't actually save any computation time or memory, though they might save space (but don't necessarily):

src:/doc/trunk/www/delta-manifests.md

(3) By Richard Hipp (drh) on 2024-04-13 11:54:38 in reply to 1 [link] [source]

Thanks for the report.

I'm curious to know stats for your repository. Can you somehow post or otherwise make available summary information about your NetBSD Fossil repo? I'm interested in pages like this:

  • /stat
  • /artifact_stats
  • /hash-collisions
  • /repo-tabsize

Most (maybe all?) of the above pages are only accessible to someone with admin rights. You should be able to see them using "fossil ui", however.

Another interesting datapoint would be to see the output of the sqlite3_analyzer utility program run against your NetBSD repository file.

If you can gather that data and send it to me, it seems like it might make an interesting documentation page for the Fossil website.

(5) By Andy Bradford (andybradford) on 2024-04-13 15:34:38 in reply to 3 [link] [source]

>  I'm interested in pages like /artifact_stats

I tried to get  that from my own clone of the  NetBSD SRC repository and
got this:

Timeout after 600 seconds during /artifact_stats - user 41,320,000 µs, sys 75,900,000 µs

Andy

(6) By anonymous on 2024-04-13 22:34:46 in reply to 3 [link] [source]

Hi Richard,

thank you for taking interest on my adventures.

By the recommendation of another Fossil user, I have made the entire repo available to everybody in my VPS/Fossil installation. Feel free to clone it!!!!

Here is the information you requested:

  • /stat (1.42 secs to generate)
Repository Size:	7,858,610,176 bytes
Number Of Artifacts:	3,091,872 (842,497 fulltext and 2,249,375 deltas) Details
Uncompressed Artifact Size:	2,193,333 bytes average, 29,567,704 bytes max, 6,781,507,240,517 total
Compression Ratio:	862:1
Number Of Check-ins:	761,304
Number Of Files:	529,601
Number Of Wiki Pages:	0
Project Age:	31 years, 9 months, 0 days
Project ID: 	4ca53016b34b01dbda4a5c75413c2a240d085c5f
Fossil Version:	2023-11-01 18:56:47 [47362306a7] (2.23) (details)
SQLite Version:	2024-03-12 11:06:23 [d8cd6d49b4] (3.45.2) (details)
OpenSSL Version: 	OpenSSL 3.1.4 24 Oct 2023 (0x030100040)
Web Server:	fossil version 2.23 [47362306a7] 2023-11-01 18:56:47
Schema Version:	2015-01-24, sha3
Repository Rebuilt:	2024-04-09 17:33:45 By Fossil 2.23 [47362306a7] 2023-11-01 18:56:47 UTC
Database Stats:	1,918,606 pages, 4096 bytes/page, 0 free pages, UTF-8, delete mode
Backoffice: 	Last run: 32 seconds ago
  • /artifact_stats (16.38 secs to generate)
Overall Artifact Size Statistics:
Number of artifacts:	3,091,872
Number of deltas:	2,249,375 (72%)
Number of full-text:	842,497 (27%)
Uncompressed artifact sizes:	largest: 29,567,704, average: 2,193,333, median: 12,310
Compressed artifact sizes:	largest: 9,730,513, average: 1,536, median: 239
Delta artifact sizes:	largest: 4,723,551, average: 410, median: 163
Full-text artifact sizes: 	largest: 9,730,513, average: 4,542, median: 1,599
Artifact Size Distribution Facts:

    The largest 1.71% of artifacts (the largest 53,005 artifacts) use 50% of the total artifact space.

    The largest 1% of artifacts (the largest 30,919 artifacts) use 43% of the total artifact space.

    The largest 10% of artifacts (the largest 309,188 artifacts) use 77% of the total artifact space.

    The largest 25% of artifacts (the largest 618,375 artifacts) use 88% of the total artifact space.

    The largest 50% of artifacts (the largest 1,545,936 artifacts) use 96% of the total artifact space. 

Artifact Sizes By Type:

Artifact Type 	Count 	Full-Text 	Delta 	Compressed Size 	Uncompressed Size
cluster 	3,860 	3,860 	0 	114,246,436 	207,161,616
manifest 	761,304 	719 	760,585 	1,115,181,821 	6,730,705,097,981
file 	2,326,708 	837,918 	1,488,790 	3,522,326,726 	50,594,980,920
ALL 	3,091,872 	842,497 	2,249,375 	4,751,754,983 	6,781,507,240,517
  • /hash_collisions (1 sec to generate)
Hash Prefix Collisions on Check-ins
Length	Instances	First Instance
1	240	00fff6d9117465b931719981a84332efbebcc2089785ea078b8ccf244f2fa076
2	3840	000fd3789877f8a890a1c721fff89e04d817818fe138a47832526b6a5d0dd8ff
3	61440	0000fe9ca8c60097089f08c7c8dfd4e1ec65b88ed91e19882bad5a09c93c4657
4	476469	000003e221de59ca039c27437588298f93e328b3dde25341486d541ced6d2837
5	202547	00005082f03fddf7bdf09b14fab67e2f186c1cd73dd1ac2590aa0ccbf6274ed5
6	15726	0002a7eb670643f26e2ea58a06788ad6ab845b660f56312284ff7c9fd174f18a
7	962	0077da93f39ca060443afe94c0664d5baa1723715106770e6de40519ad3dbb0d
8	62	04ae355b0b078b4eb9e918fb1c50d8d7386b0b1ed33de6fdf12802b7f71c9eb4
9	2	b5e58fcf860c1bdf39c340f7ef1a3005c3c80a29c34a217717a954354c4b9634

Total number of hashes: 761304

Collisions of length 9: b5e58fcf8 f7d6e3c41

First 25 collisions of length 8: 04ae355b 06f6163b 083b9710 0e0a9685 100724fa 13d29173 13fd9ac7 1516cea4 17ff6b2c 1877ff2e 27d36ad0 27eb485b 2cf43cc2 2e85b54c 2eff40de 34eec22e 3a7a8060 427d094d 458a0eb4 464e6b66 4df4a555 519a6ff4 5299c024 5a2a4050 612b5f64
Hash Prefix Collisions on All Artifacts
Length	Instances	First Instance
1	240	00fffd366f0a0da7d7114a1f8772d5affecf270862714b00336443a46d28f7a1
2	3840	000ff863894ae27eb7dcc08beecb0690f3569e5fa0cb7e3f075fcfbbb275085f
3	61440	0000fe9ca8c60097089f08c7c8dfd4e1ec65b88ed91e19882bad5a09c93c4657
4	928319	000003e221de59ca039c27437588298f93e328b3dde25341486d541ced6d2837
5	1829783	0000013bedd9f8b2fafddad578473a7d138e2ff3ee8ca9712f8415d2f6220dd3
6	250723	000049aa6e334a752f0822b45e3dd2c00d653bf7b5d06655f7b1c2d90f90518f
7	16410	000a12609dab921d6cd93b062a7a967a1300e13e6137a0abe14dd8d393c50f6e
8	1041	0008337bd5283d3bf48fd0f171d1d41433a0cd9502ffad828ed7d6ba7115c4b8
9	55	01a5e8c62c1b608061cb264f3527524f5e279bfaf1f6a6e93009d1feb71ebaea
10	4	1ea829ba31b0831e06abc604c7f0e82a3e41971559ce4c8d88dafd056b3a7e24
11	1	ad0e1480b28392137473242e4e04dd2acb7fc61e0ac03bb2c4c142cf312205dd

Total number of hashes: 3091872

Collisions of length 11: ad0e1480b28

Collisions of length 10: 1ea829ba31 547546dd31 6a55f82aaa d120b4c419

First 25 collisions of length 9: 01a5e8c62 08e4e6c4c 0c0d1162c 1393fa1db 1dd8cf7ee 2306b3b5b 2b17b9be3 33d9c440a 37ba69c73 3e8eaee75 3f6ec36f0 41ac801a4 44eab6d1a 461433742 4b8ae0d66 5877e7718 60173a6fa 67f490bfb 6bb42325a 6ca4c0414 6e2ebbb47 6ee887455 74091e3bc 78b99474a 7ccdba55e 
  • /repo_tabsize (2.2 secs to generate)

Repo Size: 7.9 GB: 73% blob, 21% mlink, 2% event, 2% tagxref, 2% 23 others

.fslockout Size: 35.4MB: 100% vfile

  • SQLite3_Analyzer:
time sqlite3_analyzer ../NetBSD.fossil 

/** Disk-Space Utilization Report For ../NetBSD.fossil

Page size in bytes................................ 4096      
Pages in the whole file (measured)................ 1918606   
Pages in the whole file (calculated).............. 1918606   
Pages that store data............................. 1918605    100.000% 
Pages on the freelist (per header)................ 0            0.0% 
Pages on the freelist (calculated)................ 0            0.0% 
Pages of auto-vacuum overhead..................... 0            0.0% 
Number of tables in the database.................. 27        
Number of indices................................. 27        
Number of defined indices......................... 14        
Number of implied indices......................... 13        
Size of the file in bytes......................... 7858610176
Bytes of user payload stored...................... 5706547447  72.6% 

*** Page counts for all tables with their indices *****************************

BLOB.............................................. 1394886     72.7% 
MLINK............................................. 405269      21.1% 
TAGXREF........................................... 39000        2.0% 
EVENT............................................. 38570        2.0% 
FILENAME.......................................... 16620        0.87% 
DELTA............................................. 13394        0.70% 
PLINK............................................. 10810        0.56% 
TAG............................................... 12           0.0% 
UNCLUSTERED....................................... 6            0.0% 
BACKLINK.......................................... 5            0.0% 
ATTACHMENT........................................ 3            0.0% 
LEAF.............................................. 3            0.0% 
SQLITE_SCHEMA..................................... 3            0.0% 
CHERRYPICK........................................ 2            0.0% 
CONCEALED......................................... 2            0.0% 
CONFIG............................................ 2            0.0% 
ORPHAN............................................ 2            0.0% 
RCVFROM........................................... 2            0.0% 
REPORTFMT......................................... 2            0.0% 
SHUN.............................................. 2            0.0% 
TICKET............................................ 2            0.0% 
TICKETCHNG........................................ 2            0.0% 
USER.............................................. 2            0.0% 
PHANTOM........................................... 1            0.0% 
PRIVATE........................................... 1            0.0% 
SQLITE_STAT1...................................... 1            0.0% 
UNSENT............................................ 1            0.0% 

*** Page counts for all tables and indices separately *************************

BLOB.............................................. 1338610     69.8% 
MLINK............................................. 150811       7.9% 
MLINK_I1.......................................... 67012        3.5% 
MLINK_I2.......................................... 66019        3.4% 
MLINK_I4.......................................... 65347        3.4% 
SQLITE_AUTOINDEX_BLOB_1........................... 56276        2.9% 
MLINK_I3.......................................... 56080        2.9% 
EVENT............................................. 35395        1.8% 
TAGXREF........................................... 20197        1.1% 
TAGXREF_I1........................................ 10808        0.56% 
FILENAME.......................................... 8318         0.43% 
SQLITE_AUTOINDEX_FILENAME_1....................... 8302         0.43% 
SQLITE_AUTOINDEX_TAGXREF_1........................ 7995         0.42% 
DELTA............................................. 6782         0.35% 
DELTA_I1.......................................... 6612         0.34% 
PLINK............................................. 4854         0.25% 
EVENT_I1.......................................... 3175         0.17% 
PLINK_I2.......................................... 2978         0.16% 
SQLITE_AUTOINDEX_PLINK_1.......................... 2978         0.16% 
SQLITE_AUTOINDEX_TAG_1............................ 6            0.0% 
TAG............................................... 6            0.0% 
UNCLUSTERED....................................... 6            0.0% 
BACKLINK.......................................... 3            0.0% 
LEAF.............................................. 3            0.0% 
SQLITE_SCHEMA..................................... 3            0.0% 
ATTACHMENT........................................ 1            0.0% 
ATTACHMENT_IDX1................................... 1            0.0% 
ATTACHMENT_IDX2................................... 1            0.0% 
BACKLINK_SRC...................................... 1            0.0% 
CHERRYPICK........................................ 1            0.0% 
CHERRYPICK_CID.................................... 1            0.0% 
CONCEALED......................................... 1            0.0% 
CONFIG............................................ 1            0.0% 
ORPHAN............................................ 1            0.0% 
ORPHAN_BASELINE................................... 1            0.0% 
PHANTOM........................................... 1            0.0% 
PRIVATE........................................... 1            0.0% 
RCVFROM........................................... 1            0.0% 
REPORTFMT......................................... 1            0.0% 
SHUN.............................................. 1            0.0% 
SQLITE_AUTOINDEX_BACKLINK_1....................... 1            0.0% 
SQLITE_AUTOINDEX_CONCEALED_1...................... 1            0.0% 
SQLITE_AUTOINDEX_CONFIG_1......................... 1            0.0% 
SQLITE_AUTOINDEX_RCVFROM_1........................ 1            0.0% 
SQLITE_AUTOINDEX_REPORTFMT_1...................... 1            0.0% 
SQLITE_AUTOINDEX_SHUN_1........................... 1            0.0% 
SQLITE_AUTOINDEX_TICKET_1......................... 1            0.0% 
SQLITE_AUTOINDEX_USER_1........................... 1            0.0% 
SQLITE_STAT1...................................... 1            0.0% 
TICKET............................................ 1            0.0% 
TICKETCHNG........................................ 1            0.0% 
TICKETCHNG_IDX1................................... 1            0.0% 
UNSENT............................................ 1            0.0% 
USER.............................................. 1            0.0% 

*** All tables and indices ****************************************************

Percentage of total database...................... 100.000%  
Number of entries................................. 130773625 
Bytes of storage consumed......................... 7858606080
Bytes of payload.................................. 6849183740  87.2% 
Bytes of metadata................................. 535594573    6.8% 
Average payload per entry......................... 52.37     
Average unused bytes per entry.................... 3.64      
Average metadata per entry........................ 4.10      
Average fanout.................................... 256.00    
Maximum payload per entry......................... 9730591   
Entries that use overflow......................... 200807       0.15% 
Index pages used.................................. 4589      
Primary pages used................................ 1174391   
Overflow pages used............................... 739625    
Total pages used.................................. 1918605   
Unused bytes on index pages....................... 1292765      6.9% 
Unused bytes on primary pages..................... 464211550    9.7% 
Unused bytes on overflow pages.................... 10478724     0.35% 
Unused bytes on all pages......................... 475983039    6.1% 

*** All tables ****************************************************************

Percentage of total database......................  81.6%    
Number of entries................................. 31355701  
Bytes of storage consumed......................... 6410252288
Bytes of payload.................................. 5706553389  89.0% 
Bytes of metadata................................. 233094913    3.6% 
Average payload per entry......................... 181.99    
Average unused bytes per entry.................... 15.08     
Average metadata per entry........................ 7.43      
Average fanout.................................... 376.00    
Maximum payload per entry......................... 9730591   
Entries that use overflow......................... 200807       0.64% 
Index pages used.................................. 2190      
Primary pages used................................ 823188    
Overflow pages used............................... 739625    
Total pages used.................................. 1565003   
Unused bytes on index pages....................... 1167152     13.0% 
Unused bytes on primary pages..................... 461113382   13.7% 
Unused bytes on overflow pages.................... 10478724     0.35% 
Unused bytes on all pages......................... 472759258    7.4% 

*** All indices ***************************************************************

Percentage of total database......................  18.4%    
Number of entries................................. 99417924  
Bytes of storage consumed......................... 1448353792
Bytes of payload.................................. 1142630351  78.9% 
Bytes of metadata................................. 302499660   20.9% 
Average payload per entry......................... 11.49     
Average unused bytes per entry.................... 0.03      
Average metadata per entry........................ 3.04      
Average fanout.................................... 147.00    
Maximum payload per entry......................... 197       
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 2399      
Primary pages used................................ 351203    
Overflow pages used............................... 0         
Total pages used.................................. 353602    
Unused bytes on index pages....................... 125613       1.3% 
Unused bytes on primary pages..................... 3098168      0.22% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 3223781      0.22% 

*** Table ATTACHMENT and all its indices **************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 12288     
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 24           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 3         
Overflow pages used............................... 0         
Total pages used.................................. 3         
Unused bytes on primary pages..................... 12264       99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 12264       99.80% 

*** Table ATTACHMENT w/o any indices ******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Indices of table ATTACHMENT ***********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Index ATTACHMENT_IDX1 of table ATTACHMENT *********************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index ATTACHMENT_IDX2 of table ATTACHMENT *********************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table BACKLINK and all its indices ****************************************

Percentage of total database......................   0.0%    
Number of entries................................. 672       
Bytes of storage consumed......................... 20480     
Bytes of payload.................................. 9814        47.9% 
Bytes of metadata................................. 2449        12.0% 
Average payload per entry......................... 14.60     
Average unused bytes per entry.................... 12.23     
Average metadata per entry........................ 3.64      
Average fanout.................................... 4.00      
Maximum payload per entry......................... 26        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 4         
Overflow pages used............................... 0         
Total pages used.................................. 5         
Unused bytes on index pages....................... 4076        99.51% 
Unused bytes on primary pages..................... 4141        25.3% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8217        40.1% 

*** Table BACKLINK w/o any indices ********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 224       
Bytes of storage consumed......................... 12288     
Bytes of payload.................................. 4639        37.8% 
Bytes of metadata................................. 1089         8.9% 
B-tree depth...................................... 2         
Average payload per entry......................... 20.71     
Average unused bytes per entry.................... 29.29     
Average metadata per entry........................ 4.86      
Average fanout.................................... 2.00      
Non-sequential pages.............................. 1           50.0% 
Maximum payload per entry......................... 26        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 3         
Unused bytes on index pages....................... 4076        99.51% 
Unused bytes on primary pages..................... 2484        30.3% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 6560        53.4% 

*** Indices of table BACKLINK *************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 448       
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 5175        63.2% 
Bytes of metadata................................. 1360        16.6% 
Average payload per entry......................... 11.55     
Average unused bytes per entry.................... 3.70      
Average metadata per entry........................ 3.04      
Maximum payload per entry......................... 20        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 1657        20.2% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 1657        20.2% 

*** Index BACKLINK_SRC of table BACKLINK **************************************

Percentage of total database......................   0.0%    
Number of entries................................. 224       
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 1948        47.6% 
Bytes of metadata................................. 680         16.6% 
B-tree depth...................................... 1         
Average payload per entry......................... 8.70      
Average unused bytes per entry.................... 6.55      
Average metadata per entry........................ 3.04      
Maximum payload per entry......................... 9         
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 1468        35.8% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 1468        35.8% 

*** Index SQLITE_AUTOINDEX_BACKLINK_1 of table BACKLINK ***********************

Percentage of total database......................   0.0%    
Number of entries................................. 224       
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 3227        78.8% 
Bytes of metadata................................. 680         16.6% 
B-tree depth...................................... 1         
Average payload per entry......................... 14.41     
Average unused bytes per entry.................... 0.84      
Average metadata per entry........................ 3.04      
Maximum payload per entry......................... 20        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 189          4.6% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 189          4.6% 

*** Table BLOB and all its indices ********************************************

Percentage of total database......................  72.7%    
Number of entries................................. 6183744   
Bytes of storage consumed......................... 5713453056
Bytes of payload.................................. 5201257447  91.0% 
Bytes of metadata................................. 48766099     0.85% 
Average payload per entry......................... 841.12    
Average unused bytes per entry.................... 75.29     
Average metadata per entry........................ 7.89      
Average fanout.................................... 249.00    
Maximum payload per entry......................... 9730591   
Entries that use overflow......................... 200036       3.2% 
Index pages used.................................. 2641      
Primary pages used................................ 656550    
Overflow pages used............................... 735695    
Total pages used.................................. 1394886   
Unused bytes on index pages....................... 846867       7.8% 
Unused bytes on primary pages..................... 454279999   16.9% 
Unused bytes on overflow pages.................... 10445280     0.35% 
Unused bytes on all pages......................... 465572146    8.1% 

*** Table BLOB w/o any indices ************************************************

Percentage of total database......................  69.8%    
Number of entries................................. 3091872   
Bytes of storage consumed......................... 5482946560
Bytes of payload.................................. 4981767430  90.9% 
Bytes of metadata................................. 38815175     0.71% 
B-tree depth...................................... 4         
Average payload per entry......................... 1611.25   
Average unused bytes per entry.................... 150.23    
Average metadata per entry........................ 12.55     
Average fanout.................................... 382.00    
Non-sequential pages.............................. 1            0.0% 
Maximum payload per entry......................... 9730591   
Entries that use overflow......................... 200036       6.5% 
Index pages used.................................. 1578      
Primary pages used................................ 601337    
Overflow pages used............................... 735695    
Total pages used.................................. 1338610   
Unused bytes on index pages....................... 811518      12.6% 
Unused bytes on primary pages..................... 453249793   18.4% 
Unused bytes on overflow pages.................... 10445280     0.35% 
Unused bytes on all pages......................... 464506591    8.5% 

*** Index SQLITE_AUTOINDEX_BLOB_1 of table BLOB *******************************

Percentage of total database......................   2.9%    
Number of entries................................. 3091872   
Bytes of storage consumed......................... 230506496 
Bytes of payload.................................. 219490017   95.2% 
Bytes of metadata................................. 9950924      4.3% 
B-tree depth...................................... 4         
Average payload per entry......................... 70.99     
Average unused bytes per entry.................... 0.34      
Average metadata per entry........................ 3.22      
Average fanout.................................... 52.00     
Non-sequential pages.............................. 1            0.002% 
Maximum payload per entry......................... 71        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1063      
Primary pages used................................ 55213     
Overflow pages used............................... 0         
Total pages used.................................. 56276     
Unused bytes on index pages....................... 35349        0.81% 
Unused bytes on primary pages..................... 1030206      0.46% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 1065555      0.46% 

*** Table CHERRYPICK and all its indices **************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Table CHERRYPICK w/o any indices ******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index CHERRYPICK_CID of table CHERRYPICK **********************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table CONCEALED and all its indices ***************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Table CONCEALED w/o any indices *******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index SQLITE_AUTOINDEX_CONCEALED_1 of table CONCEALED *********************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table CONFIG and all its indices ******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 28        
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 690          8.4% 
Bytes of metadata................................. 114          1.4% 
Average payload per entry......................... 24.64     
Average unused bytes per entry.................... 263.86    
Average metadata per entry........................ 4.07      
Maximum payload per entry......................... 60        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 7388        90.2% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 7388        90.2% 

*** Table CONFIG w/o any indices **********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 14        
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 455         11.1% 
Bytes of metadata................................. 64           1.6% 
B-tree depth...................................... 1         
Average payload per entry......................... 32.50     
Average unused bytes per entry.................... 255.50    
Average metadata per entry........................ 4.57      
Maximum payload per entry......................... 60        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 3577        87.3% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 3577        87.3% 

*** Index SQLITE_AUTOINDEX_CONFIG_1 of table CONFIG ***************************

Percentage of total database......................   0.0%    
Number of entries................................. 14        
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 235          5.7% 
Bytes of metadata................................. 50           1.2% 
B-tree depth...................................... 1         
Average payload per entry......................... 16.79     
Average unused bytes per entry.................... 272.21    
Average metadata per entry........................ 3.57      
Maximum payload per entry......................... 44        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 3811        93.0% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 3811        93.0% 

*** Table DELTA and all its indices *******************************************

Percentage of total database......................   0.70%   
Number of entries................................. 4498750   
Bytes of storage consumed......................... 54861824  
Bytes of payload.................................. 33668935    61.4% 
Bytes of metadata................................. 21066293    38.4% 
Average payload per entry......................... 7.48      
Average unused bytes per entry.................... 0.03      
Average metadata per entry........................ 4.68      
Average fanout.................................... 291.00    
Maximum payload per entry......................... 9         
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 46        
Primary pages used................................ 13348     
Overflow pages used............................... 0         
Total pages used.................................. 13394     
Unused bytes on index pages....................... 19786       10.5% 
Unused bytes on primary pages..................... 106810       0.20% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 126596       0.23% 

*** Table DELTA w/o any indices ***********************************************

Percentage of total database......................   0.35%   
Number of entries................................. 2249375   
Bytes of storage consumed......................... 27779072  
Bytes of payload.................................. 13474374    48.5% 
Bytes of metadata................................. 14238828    51.3% 
B-tree depth...................................... 3         
Average payload per entry......................... 5.99      
Average unused bytes per entry.................... 0.03      
Average metadata per entry........................ 6.33      
Average fanout.................................... 356.00    
Non-sequential pages.............................. 1            0.015% 
Maximum payload per entry......................... 6         
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 19        
Primary pages used................................ 6763      
Overflow pages used............................... 0         
Total pages used.................................. 6782      
Unused bytes on index pages....................... 14736       18.9% 
Unused bytes on primary pages..................... 51134        0.18% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 65870        0.24% 

*** Index DELTA_I1 of table DELTA *********************************************

Percentage of total database......................   0.34%   
Number of entries................................. 2249375   
Bytes of storage consumed......................... 27082752  
Bytes of payload.................................. 20194561    74.6% 
Bytes of metadata................................. 6827465     25.2% 
B-tree depth...................................... 3         
Average payload per entry......................... 8.98      
Average unused bytes per entry.................... 0.03      
Average metadata per entry........................ 3.04      
Average fanout.................................... 244.00    
Non-sequential pages.............................. 1            0.015% 
Maximum payload per entry......................... 9         
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 27        
Primary pages used................................ 6585      
Overflow pages used............................... 0         
Total pages used.................................. 6612      
Unused bytes on index pages....................... 5050         4.6% 
Unused bytes on primary pages..................... 55676        0.21% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 60726        0.22% 

*** Table EVENT and all its indices *******************************************

Percentage of total database......................   2.0%    
Number of entries................................. 1522608   
Bytes of storage consumed......................... 157982720 
Bytes of payload.................................. 144096888   91.2% 
Bytes of metadata................................. 7875505      5.0% 
Average payload per entry......................... 94.64     
Average unused bytes per entry.................... 3.96      
Average metadata per entry........................ 5.17      
Average fanout.................................... 346.00    
Maximum payload per entry......................... 546129    
Entries that use overflow......................... 771          0.051% 
Index pages used.................................. 100       
Primary pages used................................ 34540     
Overflow pages used............................... 3930      
Total pages used.................................. 38570     
Unused bytes on index pages....................... 52421       12.8% 
Unused bytes on primary pages..................... 5937098      4.2% 
Unused bytes on overflow pages.................... 33444        0.21% 
Unused bytes on all pages......................... 6022963      3.8% 

*** Table EVENT w/o any indices ***********************************************

Percentage of total database......................   1.8%    
Number of entries................................. 761304    
Bytes of storage consumed......................... 144977920 
Bytes of payload.................................. 133447140   92.0% 
Bytes of metadata................................. 5553497      3.8% 
B-tree depth...................................... 3         
Average payload per entry......................... 175.29    
Average unused bytes per entry.................... 7.87      
Average metadata per entry........................ 7.29      
Average fanout.................................... 383.00    
Non-sequential pages.............................. 1            0.003% 
Maximum payload per entry......................... 546129    
Entries that use overflow......................... 771          0.10% 
Index pages used.................................. 82        
Primary pages used................................ 31383     
Overflow pages used............................... 3930      
Total pages used.................................. 35395     
Unused bytes on index pages....................... 45154       13.4% 
Unused bytes on primary pages..................... 5911321      4.6% 
Unused bytes on overflow pages.................... 33444        0.21% 
Unused bytes on all pages......................... 5989919      4.1% 

*** Index EVENT_I1 of table EVENT *********************************************

Percentage of total database......................   0.17%   
Number of entries................................. 761304    
Bytes of storage consumed......................... 13004800  
Bytes of payload.................................. 10649748    81.9% 
Bytes of metadata................................. 2322008     17.9% 
B-tree depth...................................... 3         
Average payload per entry......................... 13.99     
Average unused bytes per entry.................... 0.04      
Average metadata per entry........................ 3.05      
Average fanout.................................... 176.00    
Non-sequential pages.............................. 1            0.032% 
Maximum payload per entry......................... 14        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 18        
Primary pages used................................ 3157      
Overflow pages used............................... 0         
Total pages used.................................. 3175      
Unused bytes on index pages....................... 7267         9.9% 
Unused bytes on primary pages..................... 25777        0.20% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 33044        0.25% 

*** Table FILENAME and all its indices ****************************************

Percentage of total database......................   0.87%   
Number of entries................................. 1059202   
Bytes of storage consumed......................... 68075520  
Bytes of payload.................................. 62483826    91.8% 
Bytes of metadata................................. 4995674      7.3% 
Average payload per entry......................... 58.99     
Average unused bytes per entry.................... 0.56      
Average metadata per entry........................ 4.72      
Average fanout.................................... 97.00     
Maximum payload per entry......................... 197       
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 171       
Primary pages used................................ 16449     
Overflow pages used............................... 0         
Total pages used.................................. 16620     
Unused bytes on index pages....................... 27136        3.9% 
Unused bytes on primary pages..................... 568884       0.84% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 596020       0.88% 

*** Table FILENAME w/o any indices ********************************************

Percentage of total database......................   0.43%   
Number of entries................................. 529601    
Bytes of storage consumed......................... 34070528  
Bytes of payload.................................. 30463959    89.4% 
Bytes of metadata................................. 3304479      9.7% 
B-tree depth...................................... 3         
Average payload per entry......................... 57.52     
Average unused bytes per entry.................... 0.57      
Average metadata per entry........................ 6.24      
Average fanout.................................... 378.00    
Non-sequential pages.............................. 1            0.012% 
Maximum payload per entry......................... 194       
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 22        
Primary pages used................................ 8296      
Overflow pages used............................... 0         
Total pages used.................................. 8318      
Unused bytes on index pages....................... 15334       17.0% 
Unused bytes on primary pages..................... 286756       0.84% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 302090       0.89% 

*** Index SQLITE_AUTOINDEX_FILENAME_1 of table FILENAME ***********************

Percentage of total database......................   0.43%   
Number of entries................................. 529601    
Bytes of storage consumed......................... 34004992  
Bytes of payload.................................. 32019867    94.2% 
Bytes of metadata................................. 1691195      5.0% 
B-tree depth...................................... 4         
Average payload per entry......................... 60.46     
Average unused bytes per entry.................... 0.56      
Average metadata per entry........................ 3.19      
Average fanout.................................... 55.00     
Non-sequential pages.............................. 1            0.012% 
Maximum payload per entry......................... 197       
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 149       
Primary pages used................................ 8153      
Overflow pages used............................... 0         
Total pages used.................................. 8302      
Unused bytes on index pages....................... 11802        1.9% 
Unused bytes on primary pages..................... 282128       0.84% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 293930       0.86% 

*** Table LEAF ****************************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 606       
Bytes of storage consumed......................... 12288     
Bytes of payload.................................. 1212         9.9% 
Bytes of metadata................................. 3800        30.9% 
B-tree depth...................................... 2         
Average payload per entry......................... 2.00      
Average unused bytes per entry.................... 12.01     
Average metadata per entry........................ 6.27      
Average fanout.................................... 2.00      
Non-sequential pages.............................. 1           50.0% 
Maximum payload per entry......................... 2         
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 3         
Unused bytes on index pages....................... 4074        99.46% 
Unused bytes on primary pages..................... 3202        39.1% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 7276        59.2% 

*** Table MLINK and all its indices *******************************************

Percentage of total database......................  21.1%    
Number of entries................................. 108361225 
Bytes of storage consumed......................... 1659981824
Bytes of payload.................................. 1241750975  74.8% 
Bytes of metadata................................. 415410785   25.0% 
Average payload per entry......................... 11.46     
Average unused bytes per entry.................... 0.03      
Average metadata per entry........................ 3.83      
Average fanout.................................... 283.00    
Maximum payload per entry......................... 24        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1428      
Primary pages used................................ 403841    
Overflow pages used............................... 0         
Total pages used.................................. 405269    
Unused bytes on index pages....................... 257871       4.4% 
Unused bytes on primary pages..................... 2562193      0.15% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 2820064      0.17% 

*** Table MLINK w/o any indices ***********************************************

Percentage of total database......................   7.9%    
Number of entries................................. 21672245  
Bytes of storage consumed......................... 617721856 
Bytes of payload.................................. 464173494   75.1% 
Bytes of metadata................................. 152290365   24.7% 
B-tree depth...................................... 4         
Average payload per entry......................... 21.42     
Average unused bytes per entry.................... 0.06      
Average metadata per entry........................ 7.03      
Average fanout.................................... 359.00    
Non-sequential pages.............................. 1            0.0% 
Maximum payload per entry......................... 24        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 419       
Primary pages used................................ 150392    
Overflow pages used............................... 0         
Total pages used.................................. 150811    
Unused bytes on index pages....................... 221049      12.9% 
Unused bytes on primary pages..................... 1036948      0.17% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 1257997      0.20% 

*** Indices of table MLINK ****************************************************

Percentage of total database......................  13.3%    
Number of entries................................. 86688980  
Bytes of storage consumed......................... 1042259968
Bytes of payload.................................. 777577481   74.6% 
Bytes of metadata................................. 263120420   25.2% 
Average payload per entry......................... 8.97      
Average unused bytes per entry.................... 0.02      
Average metadata per entry........................ 3.04      
Average fanout.................................... 252.00    
Maximum payload per entry......................... 10        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1009      
Primary pages used................................ 253449    
Overflow pages used............................... 0         
Total pages used.................................. 254458    
Unused bytes on index pages....................... 36822        0.89% 
Unused bytes on primary pages..................... 1525245      0.15% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 1562067      0.15% 

*** Index MLINK_I1 of table MLINK *********************************************

Percentage of total database......................   3.5%    
Number of entries................................. 21672245  
Bytes of storage consumed......................... 274481152 
Bytes of payload.................................. 208200235   75.9% 
Bytes of metadata................................. 65820875    24.0% 
B-tree depth...................................... 4         
Average payload per entry......................... 9.61      
Average unused bytes per entry.................... 0.02      
Average metadata per entry........................ 3.04      
Average fanout.................................... 244.00    
Non-sequential pages.............................. 1            0.001% 
Maximum payload per entry......................... 10        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 274       
Primary pages used................................ 66738     
Overflow pages used............................... 0         
Total pages used.................................. 67012     
Unused bytes on index pages....................... 9401         0.84% 
Unused bytes on primary pages..................... 450641       0.16% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 460042       0.17% 

*** Index MLINK_I2 of table MLINK *********************************************

Percentage of total database......................   3.4%    
Number of entries................................. 21672245  
Bytes of storage consumed......................... 270413824 
Bytes of payload.................................. 204222122   75.5% 
Bytes of metadata................................. 65808959    24.3% 
B-tree depth...................................... 4         
Average payload per entry......................... 9.42      
Average unused bytes per entry.................... 0.02      
Average metadata per entry........................ 3.04      
Average fanout.................................... 246.00    
Non-sequential pages.............................. 1            0.002% 
Maximum payload per entry......................... 10        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 268       
Primary pages used................................ 65751     
Overflow pages used............................... 0         
Total pages used.................................. 66019     
Unused bytes on index pages....................... 11894        1.1% 
Unused bytes on primary pages..................... 370849       0.14% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 382743       0.14% 

*** Index MLINK_I3 of table MLINK *********************************************

Percentage of total database......................   2.9%    
Number of entries................................. 21672245  
Bytes of storage consumed......................... 229703680 
Bytes of payload.................................. 163687875   71.3% 
Bytes of metadata................................. 65689691    28.6% 
B-tree depth...................................... 3         
Average payload per entry......................... 7.55      
Average unused bytes per entry.................... 0.02      
Average metadata per entry........................ 3.03      
Average fanout.................................... 276.00    
Non-sequential pages.............................. 1            0.002% 
Maximum payload per entry......................... 10        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 203       
Primary pages used................................ 55877     
Overflow pages used............................... 0         
Total pages used.................................. 56080     
Unused bytes on index pages....................... 2773         0.33% 
Unused bytes on primary pages..................... 323341       0.14% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 326114       0.14% 

*** Index MLINK_I4 of table MLINK *********************************************

Percentage of total database......................   3.4%    
Number of entries................................. 21672245  
Bytes of storage consumed......................... 267661312 
Bytes of payload.................................. 201467249   75.3% 
Bytes of metadata................................. 65800895    24.6% 
B-tree depth...................................... 4         
Average payload per entry......................... 9.30      
Average unused bytes per entry.................... 0.02      
Average metadata per entry........................ 3.04      
Average fanout.................................... 247.00    
Non-sequential pages.............................. 1            0.002% 
Maximum payload per entry......................... 10        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 264       
Primary pages used................................ 65083     
Overflow pages used............................... 0         
Total pages used.................................. 65347     
Unused bytes on index pages....................... 12754        1.2% 
Unused bytes on primary pages..................... 380414       0.14% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 393168       0.15% 

*** Table ORPHAN and all its indices ******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Table ORPHAN w/o any indices **********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index ORPHAN_BASELINE of table ORPHAN *************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table PHANTOM *************************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table PLINK and all its indices *******************************************

Percentage of total database......................   0.56%   
Number of entries................................. 2283909   
Bytes of storage consumed......................... 44277760  
Bytes of payload.................................. 34900908    78.8% 
Bytes of metadata................................. 9272938     20.9% 
Average payload per entry......................... 15.28     
Average unused bytes per entry.................... 0.05      
Average metadata per entry........................ 4.06      
Average fanout.................................... 240.00    
Maximum payload per entry......................... 20        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 45        
Primary pages used................................ 10765     
Overflow pages used............................... 0         
Total pages used.................................. 10810     
Unused bytes on index pages....................... 22216       12.1% 
Unused bytes on primary pages..................... 81698        0.19% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 103914       0.23% 

*** Table PLINK w/o any indices ***********************************************

Percentage of total database......................   0.25%   
Number of entries................................. 761303    
Bytes of storage consumed......................... 19881984  
Bytes of payload.................................. 15208300    76.5% 
Bytes of metadata................................. 4633656     23.3% 
B-tree depth...................................... 3         
Average payload per entry......................... 19.98     
Average unused bytes per entry.................... 0.05      
Average metadata per entry........................ 6.09      
Average fanout.................................... 373.00    
Non-sequential pages.............................. 1            0.021% 
Maximum payload per entry......................... 20        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 13        
Primary pages used................................ 4841      
Overflow pages used............................... 0         
Total pages used.................................. 4854      
Unused bytes on index pages....................... 9628        18.1% 
Unused bytes on primary pages..................... 30400        0.15% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 40028        0.20% 

*** Indices of table PLINK ****************************************************

Percentage of total database......................   0.31%   
Number of entries................................. 1522606   
Bytes of storage consumed......................... 24395776  
Bytes of payload.................................. 19692608    80.7% 
Bytes of metadata................................. 4639282     19.0% 
Average payload per entry......................... 12.93     
Average unused bytes per entry.................... 0.04      
Average metadata per entry........................ 3.05      
Average fanout.................................... 186.00    
Maximum payload per entry......................... 13        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 32        
Primary pages used................................ 5924      
Overflow pages used............................... 0         
Total pages used.................................. 5956      
Unused bytes on index pages....................... 12588        9.6% 
Unused bytes on primary pages..................... 51298        0.21% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 63886        0.26% 

*** Index PLINK_I2 of table PLINK *********************************************

Percentage of total database......................   0.16%   
Number of entries................................. 761303    
Bytes of storage consumed......................... 12197888  
Bytes of payload.................................. 9846304     80.7% 
Bytes of metadata................................. 2319641     19.0% 
B-tree depth...................................... 3         
Average payload per entry......................... 12.93     
Average unused bytes per entry.................... 0.04      
Average metadata per entry........................ 3.05      
Average fanout.................................... 186.00    
Non-sequential pages.............................. 1            0.034% 
Maximum payload per entry......................... 13        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 16        
Primary pages used................................ 2962      
Overflow pages used............................... 0         
Total pages used.................................. 2978      
Unused bytes on index pages....................... 6294         9.6% 
Unused bytes on primary pages..................... 25649        0.21% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 31943        0.26% 

*** Index SQLITE_AUTOINDEX_PLINK_1 of table PLINK *****************************

Percentage of total database......................   0.16%   
Number of entries................................. 761303    
Bytes of storage consumed......................... 12197888  
Bytes of payload.................................. 9846304     80.7% 
Bytes of metadata................................. 2319641     19.0% 
B-tree depth...................................... 3         
Average payload per entry......................... 12.93     
Average unused bytes per entry.................... 0.04      
Average metadata per entry........................ 3.05      
Average fanout.................................... 186.00    
Non-sequential pages.............................. 1            0.034% 
Maximum payload per entry......................... 13        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 16        
Primary pages used................................ 2962      
Overflow pages used............................... 0         
Total pages used.................................. 2978      
Unused bytes on index pages....................... 6294         9.6% 
Unused bytes on primary pages..................... 25649        0.21% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 31943        0.26% 

*** Table PRIVATE *************************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table RCVFROM and all its indices *****************************************

Percentage of total database......................   0.0%    
Number of entries................................. 2         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 27           0.33% 
Bytes of metadata................................. 23           0.28% 
Average payload per entry......................... 13.50     
Average unused bytes per entry.................... 4071.00   
Average metadata per entry........................ 11.50     
Maximum payload per entry......................... 24        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8142        99.39% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8142        99.39% 

*** Table RCVFROM w/o any indices *********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 1         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 24           0.59% 
Bytes of metadata................................. 12           0.29% 
B-tree depth...................................... 1         
Average payload per entry......................... 24.00     
Average unused bytes per entry.................... 4060.00   
Average metadata per entry........................ 12.00     
Maximum payload per entry......................... 24        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4060        99.12% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4060        99.12% 

*** Index SQLITE_AUTOINDEX_RCVFROM_1 of table RCVFROM *************************

Percentage of total database......................   0.0%    
Number of entries................................. 1         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 3            0.073% 
Bytes of metadata................................. 11           0.27% 
B-tree depth...................................... 1         
Average payload per entry......................... 3.00      
Average unused bytes per entry.................... 4082.00   
Average metadata per entry........................ 11.00     
Maximum payload per entry......................... 3         
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4082        99.66% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4082        99.66% 

*** Table REPORTFMT and all its indices ***************************************

Percentage of total database......................   0.0%    
Number of entries................................. 2         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 541          6.6% 
Bytes of metadata................................. 24           0.29% 
Average payload per entry......................... 270.50    
Average unused bytes per entry.................... 3813.50   
Average metadata per entry........................ 12.00     
Maximum payload per entry......................... 527       
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 7627        93.1% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 7627        93.1% 

*** Table REPORTFMT w/o any indices *******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 1         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 527         12.9% 
Bytes of metadata................................. 13           0.32% 
B-tree depth...................................... 1         
Average payload per entry......................... 527.00    
Average unused bytes per entry.................... 3556.00   
Average metadata per entry........................ 13.00     
Maximum payload per entry......................... 527       
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 3556        86.8% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 3556        86.8% 

*** Index SQLITE_AUTOINDEX_REPORTFMT_1 of table REPORTFMT *********************

Percentage of total database......................   0.0%    
Number of entries................................. 1         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 14           0.34% 
Bytes of metadata................................. 11           0.27% 
B-tree depth...................................... 1         
Average payload per entry......................... 14.00     
Average unused bytes per entry.................... 4071.00   
Average metadata per entry........................ 11.00     
Maximum payload per entry......................... 14        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4071        99.39% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4071        99.39% 

*** Table SHUN and all its indices ********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Table SHUN w/o any indices ************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index SQLITE_AUTOINDEX_SHUN_1 of table SHUN *******************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table SQLITE_SCHEMA *******************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 54        
Bytes of storage consumed......................... 12288     
Bytes of payload.................................. 5942        48.4% 
Bytes of metadata................................. 366          3.0% 
B-tree depth...................................... 2         
Average payload per entry......................... 110.04    
Average unused bytes per entry.................... 110.74    
Average metadata per entry........................ 6.78      
Average fanout.................................... 2.00      
Non-sequential pages.............................. 2          100.0% 
Maximum payload per entry......................... 409       
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 3         
Unused bytes on index pages....................... 3977        97.1% 
Unused bytes on primary pages..................... 2003        24.5% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 5980        48.7% 

*** Table SQLITE_STAT1 ********************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 5         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 180          4.4% 
Bytes of metadata................................. 28           0.68% 
B-tree depth...................................... 1         
Average payload per entry......................... 36.00     
Average unused bytes per entry.................... 777.60    
Average metadata per entry........................ 5.60      
Maximum payload per entry......................... 48        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 3888        94.9% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 3888        94.9% 

*** Table TAG and all its indices *********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 1234      
Bytes of storage consumed......................... 49152     
Bytes of payload.................................. 30874       62.8% 
Bytes of metadata................................. 4961        10.1% 
Average payload per entry......................... 25.02     
Average unused bytes per entry.................... 10.79     
Average metadata per entry........................ 4.02      
Average fanout.................................... 5.00      
Maximum payload per entry......................... 43        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 2         
Primary pages used................................ 10        
Overflow pages used............................... 0         
Total pages used.................................. 12        
Unused bytes on index pages....................... 7996        97.6% 
Unused bytes on primary pages..................... 5321        13.0% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 13317       27.1% 

*** Table TAG w/o any indices *************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 617       
Bytes of storage consumed......................... 24576     
Bytes of payload.................................. 14884       60.6% 
Bytes of metadata................................. 3042        12.4% 
B-tree depth...................................... 2         
Average payload per entry......................... 24.12     
Average unused bytes per entry.................... 10.78     
Average metadata per entry........................ 4.93      
Average fanout.................................... 5.00      
Non-sequential pages.............................. 1           20.0% 
Maximum payload per entry......................... 41        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 5         
Overflow pages used............................... 0         
Total pages used.................................. 6         
Unused bytes on index pages....................... 4052        98.9% 
Unused bytes on primary pages..................... 2598        12.7% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 6650        27.1% 

*** Index SQLITE_AUTOINDEX_TAG_1 of table TAG *********************************

Percentage of total database......................   0.0%    
Number of entries................................. 617       
Bytes of storage consumed......................... 24576     
Bytes of payload.................................. 15990       65.1% 
Bytes of metadata................................. 1919         7.8% 
B-tree depth...................................... 2         
Average payload per entry......................... 25.92     
Average unused bytes per entry.................... 10.81     
Average metadata per entry........................ 3.11      
Average fanout.................................... 6.00      
Non-sequential pages.............................. 1           20.0% 
Maximum payload per entry......................... 43        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 5         
Overflow pages used............................... 0         
Total pages used.................................. 6         
Unused bytes on index pages....................... 3944        96.3% 
Unused bytes on primary pages..................... 2723        13.3% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 6667        27.1% 

*** Table TAGXREF and all its indices *****************************************

Percentage of total database......................   2.0%    
Number of entries................................. 6859650   
Bytes of storage consumed......................... 159744000 
Bytes of payload.................................. 130971359   82.0% 
Bytes of metadata................................. 28181759    17.6% 
Average payload per entry......................... 19.09     
Average unused bytes per entry.................... 0.09      
Average metadata per entry........................ 4.11      
Average fanout.................................... 256.00    
Maximum payload per entry......................... 61        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 152       
Primary pages used................................ 38848     
Overflow pages used............................... 0         
Total pages used.................................. 39000     
Unused bytes on index pages....................... 42301        6.8% 
Unused bytes on primary pages..................... 548581       0.34% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 590882       0.37% 

*** Table TAGXREF w/o any indices *********************************************

Percentage of total database......................   1.1%    
Number of entries................................. 2286550   
Bytes of storage consumed......................... 82726912  
Bytes of payload.................................. 67986764    82.2% 
Bytes of metadata................................. 14236831    17.2% 
B-tree depth...................................... 3         
Average payload per entry......................... 29.73     
Average unused bytes per entry.................... 0.22      
Average metadata per entry........................ 6.23      
Average fanout.................................... 388.00    
Non-sequential pages.............................. 1            0.005% 
Maximum payload per entry......................... 61        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 52        
Primary pages used................................ 20145     
Overflow pages used............................... 0         
Total pages used.................................. 20197     
Unused bytes on index pages....................... 29510       13.9% 
Unused bytes on primary pages..................... 473807       0.57% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 503317       0.61% 

*** Indices of table TAGXREF **************************************************

Percentage of total database......................   0.98%   
Number of entries................................. 4573100   
Bytes of storage consumed......................... 77017088  
Bytes of payload.................................. 62984595    81.8% 
Bytes of metadata................................. 13944928    18.1% 
Average payload per entry......................... 13.77     
Average unused bytes per entry.................... 0.02      
Average metadata per entry........................ 3.05      
Average fanout.................................... 188.00    
Maximum payload per entry......................... 17        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 100       
Primary pages used................................ 18703     
Overflow pages used............................... 0         
Total pages used.................................. 18803     
Unused bytes on index pages....................... 12791        3.1% 
Unused bytes on primary pages..................... 74774        0.098% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 87565        0.11% 

*** Index SQLITE_AUTOINDEX_TAGXREF_1 of table TAGXREF *************************

Percentage of total database......................   0.42%   
Number of entries................................. 2286550   
Bytes of storage consumed......................... 32747520  
Bytes of payload.................................. 25763182    78.7% 
Bytes of metadata................................. 6955586     21.2% 
B-tree depth...................................... 3         
Average payload per entry......................... 11.27     
Average unused bytes per entry.................... 0.01      
Average metadata per entry........................ 3.04      
Average fanout.................................... 216.00    
Non-sequential pages.............................. 1            0.013% 
Maximum payload per entry......................... 12        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 37        
Primary pages used................................ 7958      
Overflow pages used............................... 0         
Total pages used.................................. 7995      
Unused bytes on index pages....................... 5732         3.8% 
Unused bytes on primary pages..................... 23020        0.071% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 28752        0.088% 

*** Index TAGXREF_I1 of table TAGXREF *****************************************

Percentage of total database......................   0.56%   
Number of entries................................. 2286550   
Bytes of storage consumed......................... 44269568  
Bytes of payload.................................. 37221413    84.1% 
Bytes of metadata................................. 6989342     15.8% 
B-tree depth...................................... 3         
Average payload per entry......................... 16.28     
Average unused bytes per entry.................... 0.03      
Average metadata per entry........................ 3.06      
Average fanout.................................... 171.00    
Non-sequential pages.............................. 1            0.009% 
Maximum payload per entry......................... 17        
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 63        
Primary pages used................................ 10745     
Overflow pages used............................... 0         
Total pages used.................................. 10808     
Unused bytes on index pages....................... 7059         2.7% 
Unused bytes on primary pages..................... 51754        0.12% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 58813        0.13% 

*** Table TICKET and all its indices ******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Table TICKET w/o any indices **********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index SQLITE_AUTOINDEX_TICKET_1 of table TICKET ***************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table TICKETCHNG and all its indices **************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 16           0.20% 
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 8176        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 8176        99.80% 

*** Table TICKETCHNG w/o any indices ******************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Index TICKETCHNG_IDX1 of table TICKETCHNG *********************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table UNCLUSTERED *********************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 1924      
Bytes of storage consumed......................... 24576     
Bytes of payload.................................. 3848        15.7% 
Bytes of metadata................................. 13560       55.2% 
B-tree depth...................................... 2         
Average payload per entry......................... 2.00      
Average unused bytes per entry.................... 3.73      
Average metadata per entry........................ 7.05      
Average fanout.................................... 5.00      
Non-sequential pages.............................. 1           20.0% 
Maximum payload per entry......................... 2         
Entries that use overflow......................... 0            0.0% 
Index pages used.................................. 1         
Primary pages used................................ 5         
Overflow pages used............................... 0         
Total pages used.................................. 6         
Unused bytes on index pages....................... 4044        98.7% 
Unused bytes on primary pages..................... 3124        15.3% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 7168        29.2% 

*** Table UNSENT **************************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 0         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 0            0.0% 
Bytes of metadata................................. 8            0.20% 
B-tree depth...................................... 1         
Average payload per entry......................... 0.0       
Average unused bytes per entry.................... 0.0       
Average metadata per entry........................ 0.0       
Maximum payload per entry......................... 0         
Entries that use overflow......................... 0         
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4088        99.80% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4088        99.80% 

*** Table USER and all its indices ********************************************

Percentage of total database......................   0.0%    
Number of entries................................. 10        
Bytes of storage consumed......................... 8192      
Bytes of payload.................................. 274          3.3% 
Bytes of metadata................................. 51           0.62% 
Average payload per entry......................... 27.40     
Average unused bytes per entry.................... 786.70    
Average metadata per entry........................ 5.10      
Maximum payload per entry......................... 67        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 2         
Overflow pages used............................... 0         
Total pages used.................................. 2         
Unused bytes on primary pages..................... 7867        96.0% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 7867        96.0% 

*** Table USER w/o any indices ************************************************

Percentage of total database......................   0.0%    
Number of entries................................. 5         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 217          5.3% 
Bytes of metadata................................. 28           0.68% 
B-tree depth...................................... 1         
Average payload per entry......................... 43.40     
Average unused bytes per entry.................... 770.20    
Average metadata per entry........................ 5.60      
Maximum payload per entry......................... 67        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 3851        94.0% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 3851        94.0% 

*** Index SQLITE_AUTOINDEX_USER_1 of table USER *******************************

Percentage of total database......................   0.0%    
Number of entries................................. 5         
Bytes of storage consumed......................... 4096      
Bytes of payload.................................. 57           1.4% 
Bytes of metadata................................. 23           0.56% 
B-tree depth...................................... 1         
Average payload per entry......................... 11.40     
Average unused bytes per entry.................... 803.20    
Average metadata per entry........................ 4.60      
Maximum payload per entry......................... 13        
Entries that use overflow......................... 0            0.0% 
Primary pages used................................ 1         
Overflow pages used............................... 0         
Total pages used.................................. 1         
Unused bytes on primary pages..................... 4016        98.0% 
Unused bytes on overflow pages.................... 0         
Unused bytes on all pages......................... 4016        98.0% 

*** Definitions ***************************************************************

Page size in bytes

    The number of bytes in a single page of the database file.  
    Usually 1024.

Number of pages in the whole file

    The number of 4096-byte pages that go into forming the complete
    database

Pages that store data

    The number of pages that store data, either as primary B*Tree pages or
    as overflow pages.  The number at the right is the data pages divided by
    the total number of pages in the file.

Pages on the freelist

    The number of pages that are not currently in use but are reserved for
    future use.  The percentage at the right is the number of freelist pages
    divided by the total number of pages in the file.

Pages of auto-vacuum overhead

    The number of pages that store data used by the database to facilitate
    auto-vacuum. This is zero for databases that do not support auto-vacuum.

Number of tables in the database

    The number of tables in the database, including the SQLITE_SCHEMA table
    used to store schema information.

Number of indices

    The total number of indices in the database.

Number of defined indices

    The number of indices created using an explicit CREATE INDEX statement.

Number of implied indices

    The number of indices used to implement PRIMARY KEY or UNIQUE constraints
    on tables.

Size of the file in bytes

    The total amount of disk space used by the entire database files.

Bytes of user payload stored

    The total number of bytes of user payload stored in the database. The
    schema information in the SQLITE_SCHEMA table is not counted when
    computing this number.  The percentage at the right shows the payload
    divided by the total file size.

Percentage of total database

    The amount of the complete database file that is devoted to storing
    information described by this category.

Number of entries

    The total number of B-Tree key/value pairs stored under this category.

Bytes of storage consumed

    The total amount of disk space required to store all B-Tree entries
    under this category.  The is the total number of pages used times
    the pages size.

Bytes of payload

    The amount of payload stored under this category.  Payload is the data
    part of table entries and the key part of index entries.  The percentage
    at the right is the bytes of payload divided by the bytes of storage 
    consumed.

Bytes of metadata

    The amount of formatting and structural information stored in the
    table or index.  Metadata includes the btree page header, the cell pointer
    array, the size field for each cell, the left child pointer or non-leaf
    cells, the overflow pointers for overflow cells, and the rowid value for
    rowid table cells.  In other words, metadata is everything that is neither
    unused space nor content.  The record header in the payload is counted as
    content, not metadata.

Average payload per entry

    The average amount of payload on each entry.  This is just the bytes of
    payload divided by the number of entries.

Average unused bytes per entry

    The average amount of free space remaining on all pages under this
    category on a per-entry basis.  This is the number of unused bytes on
    all pages divided by the number of entries.

Non-sequential pages

    The number of pages in the table or index that are out of sequence.
    Many filesystems are optimized for sequential file access so a small
    number of non-sequential pages might result in faster queries,
    especially for larger database files that do not fit in the disk cache.
    Note that after running VACUUM, the root page of each table or index is
    at the beginning of the database file and all other pages are in a
    separate part of the database file, resulting in a single non-
    sequential page.

Maximum payload per entry

    The largest payload size of any entry.

Entries that use overflow

    The number of entries that user one or more overflow pages.

Total pages used

    This is the number of pages used to hold all information in the current
    category.  This is the sum of index, primary, and overflow pages.

Index pages used

    This is the number of pages in a table B-tree that hold only key (rowid)
    information and no data.

Primary pages used

    This is the number of B-tree pages that hold both key and data.

Overflow pages used

    The total number of overflow pages used for this category.

Unused bytes on index pages

    The total number of bytes of unused space on all index pages.  The
    percentage at the right is the number of unused bytes divided by the
    total number of bytes on index pages.

Unused bytes on primary pages

    The total number of bytes of unused space on all primary pages.  The
    percentage at the right is the number of unused bytes divided by the
    total number of bytes on primary pages.

Unused bytes on overflow pages

    The total number of bytes of unused space on all overflow pages.  The
    percentage at the right is the number of unused bytes divided by the
    total number of bytes on overflow pages.

Unused bytes on all pages

    The total number of bytes of unused space on all primary and overflow 
    pages.  The percentage at the right is the number of unused bytes 
    divided by the total number of bytes.

*******************************************************************************
The entire text of this report can be sourced into any SQL database
engine for further analysis.  All of the text above is an SQL comment.
The data used to generate this report follows:
*/
BEGIN;
CREATE TABLE space_used(
   name clob,        -- Name of a table or index in the database file
   tblname clob,     -- Name of associated table
   is_index boolean, -- TRUE if it is an index, false for a table
   is_without_rowid boolean, -- TRUE if WITHOUT ROWID table  
   nentry int,       -- Number of entries in the BTree
   leaf_entries int, -- Number of leaf entries
   depth int,        -- Depth of the b-tree
   payload int,      -- Total amount of data stored in this table or index
   ovfl_payload int, -- Total amount of data stored on overflow pages
   ovfl_cnt int,     -- Number of entries that use overflow
   mx_payload int,   -- Maximum payload size
   int_pages int,    -- Number of interior pages used
   leaf_pages int,   -- Number of leaf pages used
   ovfl_pages int,   -- Number of overflow pages used
   int_unused int,   -- Number of unused bytes on interior pages
   leaf_unused int,  -- Number of unused bytes on primary pages
   ovfl_unused int,  -- Number of unused bytes on overflow pages
   gap_cnt int,      -- Number of gaps in the page layout
   compressed_size int  -- Total bytes stored on disk
);
INSERT INTO space_used VALUES('sqlite_schema','sqlite_schema',0,0,55,54,2,5942,0,0,409,1,2,0,3977,2003,0,2,12288);
INSERT INTO space_used VALUES('blob','blob',0,0,3693208,3091872,4,4981767430,3000018660,200036,9730591,1578,601337,735695,811518,453249793,10445280,1,5482946560);
INSERT INTO space_used VALUES('sqlite_autoindex_blob_1','blob',1,0,3091872,3036660,4,219490017,0,0,71,1063,55213,0,35349,1030206,0,1,230506496);
INSERT INTO space_used VALUES('delta','delta',0,0,2256137,2249375,3,13474374,0,0,6,19,6763,0,14736,51134,0,1,27779072);
INSERT INTO space_used VALUES('rcvfrom','rcvfrom',0,0,1,1,1,24,0,0,24,0,1,0,0,4060,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_rcvfrom_1','rcvfrom',1,0,1,1,1,3,0,0,3,0,1,0,0,4082,0,0,4096);
INSERT INTO space_used VALUES('user','user',0,0,5,5,1,217,0,0,67,0,1,0,0,3851,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_user_1','user',1,0,5,5,1,57,0,0,13,0,1,0,0,4016,0,0,4096);
INSERT INTO space_used VALUES('config','config',0,0,14,14,1,455,0,0,60,0,1,0,0,3577,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_config_1','config',1,0,14,14,1,235,0,0,44,0,1,0,0,3811,0,0,4096);
INSERT INTO space_used VALUES('shun','shun',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_shun_1','shun',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('private','private',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('reportfmt','reportfmt',0,0,1,1,1,527,0,0,527,0,1,0,0,3556,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_reportfmt_1','reportfmt',1,0,1,1,1,14,0,0,14,0,1,0,0,4071,0,0,4096);
INSERT INTO space_used VALUES('concealed','concealed',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_concealed_1','concealed',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('filename','filename',0,0,537896,529601,3,30463959,0,0,194,22,8296,0,15334,286756,0,1,34070528);
INSERT INTO space_used VALUES('sqlite_autoindex_filename_1','filename',1,0,529601,521449,4,32019867,0,0,197,149,8153,0,11802,282128,0,1,34004992);
INSERT INTO space_used VALUES('mlink','mlink',0,0,21822636,21672245,4,464173494,0,0,24,419,150392,0,221049,1036948,0,1,617721856);
INSERT INTO space_used VALUES('plink','plink',0,0,766143,761303,3,15208300,0,0,20,13,4841,0,9628,30400,0,1,19881984);
INSERT INTO space_used VALUES('sqlite_autoindex_plink_1','plink',1,0,761303,758342,3,9846304,0,0,13,16,2962,0,6294,25649,0,1,12197888);
INSERT INTO space_used VALUES('leaf','leaf',0,0,607,606,2,1212,0,0,2,1,2,0,4074,3202,0,1,12288);
INSERT INTO space_used VALUES('event','event',0,0,792686,761304,3,133447140,16048116,771,546129,82,31383,3930,45154,5911321,33444,1,144977920);
INSERT INTO space_used VALUES('phantom','phantom',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('orphan','orphan',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('unclustered','unclustered',0,0,1928,1924,2,3848,0,0,2,1,5,0,4044,3124,0,1,24576);
INSERT INTO space_used VALUES('unsent','unsent',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('tag','tag',0,0,621,617,2,14884,0,0,41,1,5,0,4052,2598,0,1,24576);
INSERT INTO space_used VALUES('sqlite_autoindex_tag_1','tag',1,0,617,613,2,15990,0,0,43,1,5,0,3944,2723,0,1,24576);
INSERT INTO space_used VALUES('tagxref','tagxref',0,0,2306694,2286550,3,67986764,0,0,61,52,20145,0,29510,473807,0,1,82726912);
INSERT INTO space_used VALUES('sqlite_autoindex_tagxref_1','tagxref',1,0,2286550,2278593,3,25763182,0,0,12,37,7958,0,5732,23020,0,1,32747520);
INSERT INTO space_used VALUES('backlink','backlink',0,0,225,224,2,4639,0,0,26,1,2,0,4076,2484,0,1,12288);
INSERT INTO space_used VALUES('sqlite_autoindex_backlink_1','backlink',1,0,224,224,1,3227,0,0,20,0,1,0,0,189,0,0,4096);
INSERT INTO space_used VALUES('attachment','attachment',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('cherrypick','cherrypick',0,1,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('ticket','ticket',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('sqlite_autoindex_ticket_1','ticket',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('ticketchng','ticketchng',0,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('delta_i1','delta',1,0,2249375,2242791,3,20194561,0,0,9,27,6585,0,5050,55676,0,1,27082752);
INSERT INTO space_used VALUES('mlink_i1','mlink',1,0,21672245,21605508,4,208200235,0,0,10,274,66738,0,9401,450641,0,1,274481152);
INSERT INTO space_used VALUES('mlink_i2','mlink',1,0,21672245,21606495,4,204222122,0,0,10,268,65751,0,11894,370849,0,1,270413824);
INSERT INTO space_used VALUES('mlink_i3','mlink',1,0,21672245,21616369,3,163687875,0,0,10,203,55877,0,2773,323341,0,1,229703680);
INSERT INTO space_used VALUES('mlink_i4','mlink',1,0,21672245,21607163,4,201467249,0,0,10,264,65083,0,12754,380414,0,1,267661312);
INSERT INTO space_used VALUES('plink_i2','plink',1,0,761303,758342,3,9846304,0,0,13,16,2962,0,6294,25649,0,1,12197888);
INSERT INTO space_used VALUES('event_i1','event',1,0,761304,758148,3,10649748,0,0,14,18,3157,0,7267,25777,0,1,13004800);
INSERT INTO space_used VALUES('orphan_baseline','orphan',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('tagxref_i1','tagxref',1,0,2286550,2275806,3,37221413,0,0,17,63,10745,0,7059,51754,0,1,44269568);
INSERT INTO space_used VALUES('backlink_src','backlink',1,0,224,224,1,1948,0,0,9,0,1,0,0,1468,0,0,4096);
INSERT INTO space_used VALUES('attachment_idx1','attachment',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('attachment_idx2','attachment',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('cherrypick_cid','cherrypick',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('ticketchng_idx1','ticketchng',1,0,0,0,1,0,0,0,0,0,1,0,0,4088,0,0,4096);
INSERT INTO space_used VALUES('sqlite_stat1','sqlite_stat1',0,0,5,5,1,180,0,0,48,0,1,0,0,3888,0,0,4096);
COMMIT;

real    0m18.477s
user    0m15.177s
sys     0m3.297s

(4) By Andy Bradford (andybradford) on 2024-04-13 15:16:57 in reply to 1 [link] [source]

> I used its git  mirror and I tried to export it to  Fossil for the fun
> of it.

Which one specifically did you export/import to Fossil? You say that the
final result  is 7.4GB Fossil  file? That's  not at all  consistent with
what I get when  I clone the repository from here[1]  and I thought that
one of the last  steps of cloning was to vacuum  and do additional delta
compression, so I'm surprised that they are different.

[1] https://src.fossil.netbsd.org/

My clone of that repository shows:

$ fossil dbstat -R netbsd-src.fossil
project-name:      NetBSD src
repository-size:   50,378,514,432 bytes
artifact-count:    4,310,542 (stored as 425,757 full text and 3,884,785 deltas)
artifact-sizes:    60,467 average, 29,093,223 max, 260,648,813,018 total
compression-ratio: 5:1
check-ins:         1,955,462
files:             528,030 across all branches
wiki-pages:        0 (0 changes)
tickets:           1 (1 changes)
events:            0
tag-changes:       0
latest-change:     2024-01-21 14:21:34 - about 83 days ago
project-age:       11,597 days or approximately 31.75 years.
project-id:        3109ce34a3d43fd786dcf0133c6a96a6de40c573
schema-version:    2015-01-24
fossil-version:    2024-03-23 05:54:48 [2304041e42] [2.24] (clang-13.0.0 )
sqlite-version:    2024-03-18 18:03:17 [76fb3a908f] (3.46.0)
database-stats:    6,149,721 pages, 8192 bytes/pg, 0 free pages, UTF-8, delete mode

Also, I wonder if they stopped publishing updates to it because I just now tried to pull the latest and got 0 artifacts.

Andy

(7) By anonymous on 2024-04-13 22:43:30 in reply to 4 [link] [source]

Hi Andy,

I used their Github's git repo as the source for my Fossil experiment.

Here is what I know (very little) about the NetBSD mirror. They used to use a very old Fossil version. It was like... v2.09 or something like that, I remember it was about 4 or 5 years out of date. I remember reading some changelogs for the newer versions and speedups and improvements were often mentioned. Then, the mirror stopped working for a while (few months?) and it popped up once again but using a newer version. I do not know if it was already with fossil v2.20 or something a bit older, like v2.18. I suppose, that during the update, there was no clean-up, vacuuming or other internal improvements that fossil may have gained with the years. That probably explains its size difference.

I also noticed that they stopped updating the Fossil mirror early this year. That is why you are not getting any new updates. And their page is very slow. I have uploaded my NetBSD Fossil repo to my server and it is nowhere near as slow as their server. But then again, I am using a newer fossil version and maybe my VPS has a bit more computing power...

You can also see some of my repo information in the reply I gave to Richard (awaiting moderator approval).

Best regards, Fer

(10) By Andy Bradford (andybradford) on 2024-04-15 13:19:00 in reply to 7 [source]

> I used their Github's git repo as the source for my Fossil experiment.

You used the Git repo for their SRC repository?

At  any  rate,  if it  is  indeed  the  same  repository as  the  Fossil
repository that  they host, there is  content missing from the  one that
you used.  If you compare  the stats  from the one  I cloned to  the one
you  exported/imported, you'll  notice  that the  Fossil repository  has
1,218,670 more  artifacts than  the one  that you  exported/imported. It
also has 1,194,158 more checkins. So I find that interesting.

I suppose  it's possible that  different versions of Fossil  may produce
incorrect Fossil repositories  from an export/import. Maybe  there was a
bug in Fossil when they first created the Fossil repository that created
more commits  and artifacts than  actually exist... seems  unlikely, but
certainly a possibility.

Thanks,

Andy