[Kde-scm-interest] Main repositories import finished

[Thiago Macieira]

Ok, this one apparently succeeded. It took only 4 hours and 42 minutes to 
run.

The problem was that, in the rules file, I had some slashes missing. That 
caused svn-all-fast-export to feed git-fast-import paths starting with a 
slash, which is wrong. The new rule file is attached (and compressed, 
because it's big)

Here's the output before compression:
9077    ./arts
10494   ./KDE/kdevplatform
26074   ./KDE/kdepimlibs
32668   ./KDE/kdetoys
39106   ./KDE/kdeaddons
47502   ./KDE/kdeadmin
48900   ./KDE/kdeaccessibility
86712   ./kdesupport
103321  ./KDE/kdeartwork
149089  ./KDE/kdeutils
154370  ./KDE/kdemultimedia
155592  ./KDE/kdewebdev
194057  ./KDE/kdebindings
225083  ./KDE/kdegraphics
238183  ./KDE/kdesdk
239633  ./KDE/kdegames
318350  ./KDE/kdevelop
378873  ./KDE/kdeedu
463972  ./KDE/kdenetwork
689280  ./KDE/kdepim
1163554 ./KDE/kdebase
1371148 ./KDE/kdelibs
1504294 ./koffice
7649325 total

And after repacking everything (git repack -a -d -f) -- I used two 
different computers to speed the process up -- the results are:

$ find -name objects | xargs du -sc | sort -n
1810    ./arts
2454    ./KDE/kdevplatform
6566    ./KDE/kdepimlibs
8616    ./KDE/kdeaddons
11075   ./KDE/kdeadmin
13033   ./KDE/kdetoys
20660   ./KDE/kdeaccessibility
26462   ./KDE/kdeutils
28580   ./KDE/kdewebdev
34029   ./KDE/kdesdk
34149   ./kdesupport
37805   ./KDE/kdemultimedia
44171   ./KDE/kdegraphics
56519   ./KDE/kdebindings
73392   ./KDE/kdeartwork
74857   ./KDE/kdenetwork
81031   ./KDE/kdevelop
102120  ./KDE/kdegames
106308  ./KDE/kdepim
150923  ./KDE/kdeedu
242973  ./koffice
245627  ./KDE/kdelibs
273835  ./KDE/kdebase
1676989 total

(Apparently it took longer to rsync back and forth between the two 
machines than to repack)

I still don't feel we have to slash the history. There are only a few big 
repositories. And nowadays we have a lot of development going on in 
extragear, where my plan is to have one repository per application.

Which reminds me: kdesupport wasn't meant to be a single repository. It 
should have been broken up in smaller ones.

Some more statistics:

Object count:
./arts: in-pack: 4236
./KDE/kdeaccessibility: in-pack: 28324
./KDE/kdeaddons: in-pack: 42579
./KDE/kdeadmin: in-pack: 31133
./KDE/kdeartwork: in-pack: 64187
./KDE/kdebase: in-pack: 680786
./KDE/kdebindings: in-pack: 91957
./KDE/kdeedu: in-pack: 157459
./KDE/kdegames: in-pack: 115606
./KDE/kdegraphics: in-pack: 138914
./KDE/kdelibs: in-pack: 558371
./KDE/kdemultimedia: in-pack: 114423
./KDE/kdenetwork: in-pack: 256554
./KDE/kdepim: in-pack: 314430
./KDE/kdepimlibs: in-pack: 20554
./KDE/kdesdk: in-pack: 113513
./KDE/kdetoys: in-pack: 20431
./KDE/kdeutils: in-pack: 90191
./KDE/kdevelop: in-pack: 162498
./KDE/kdevplatform: in-pack: 8991
./KDE/kdewebdev: in-pack: 65313
./kdesupport: in-pack: 53808
./koffice: in-pack: 555210

Number of commits in the master branch:
./arts: 458
./KDE/kdeaccessibility: 1909
./KDE/kdeaddons: 3046
./KDE/kdeadmin: 3339
./KDE/kdeartwork: 1890
./KDE/kdebase: 56547
./KDE/kdebindings: 3683
./KDE/kdeedu: 15622
./KDE/kdegames: 10249
./KDE/kdegraphics: 13930
./KDE/kdelibs: 66673
./KDE/kdemultimedia: 11906
./KDE/kdenetwork: 24994
./KDE/kdepim: 30931
./KDE/kdepimlibs: 2068
./KDE/kdesdk: 11559
./KDE/kdetoys: 1999
./KDE/kdeutils: 9387
./KDE/kdevelop: 12247
./KDE/kdevplatform: 828
./KDE/kdewebdev: 4988
./kdesupport: 6060
./koffice: 51871

Number of commits in all branches:
./arts: 709
./KDE/kdeaccessibility: 2233
./KDE/kdeaddons: 3850
./KDE/kdeadmin: 4021
./KDE/kdeartwork: 2382
./KDE/kdebase: 63614
./KDE/kdebindings: 4316
./KDE/kdeedu: 17021
./KDE/kdegames: 11333
./KDE/kdegraphics: 15915
./KDE/kdelibs: 74639
./KDE/kdemultimedia: 13304
./KDE/kdenetwork: 28409
./KDE/kdepim: 34876
./KDE/kdepimlibs: 2068
./KDE/kdesdk: 13695
./KDE/kdetoys: 2561
./KDE/kdeutils: 10794
./KDE/kdevelop: 14639
./KDE/kdevplatform: 828
./KDE/kdewebdev: 6060
./kdesupport: 6140
./koffice: 55863

Number of branches:
./arts: 46
./KDE/kdeaccessibility: 41
./KDE/kdeaddons: 57
./KDE/kdeadmin: 67
./KDE/kdeartwork: 60
./KDE/kdebase: 70
./KDE/kdebindings: 58
./KDE/kdeedu: 55
./KDE/kdegames: 67
./KDE/kdegraphics: 74
./KDE/kdelibs: 97
./KDE/kdemultimedia: 68
./KDE/kdenetwork: 78
./KDE/kdepim: 68
./KDE/kdepimlibs: 5
./KDE/kdesdk: 62
./KDE/kdetoys: 68
./KDE/kdeutils: 68
./KDE/kdevelop: 51
./KDE/kdevplatform: 1
./KDE/kdewebdev: 51
./kdesupport: 12
./koffice: 44

Number of Subversion revisions processed: 753574
(I updated since yesterday)

Verification of the Subversion import:
$ git cat-file -p 1eec0c16276ce3400fd9f6e7f158e2d5e03e6377
tree 9fc2d64f105c8336e6baece6a72989257c5d7f68
parent 1fef7e5eb9682890357110f61b749f84eb0d2445
author Oswald Buddenhagen <ossi at kde.org> 1198356638 -0000
committer Oswald Buddenhagen <ossi at kde.org> 1198356638 -0000

[snip]
svn path=/trunk/KDE/kdelibs/; revision=751804

(same tree SHA-1)

Unfortunately, I have just found the first glitch in this import: an UTF-8 
double-encoding of the committer name.
$ git cat-file -p HEAD
tree a23b3767a4fd67036a19090a21e6540309b94817
parent 1e0640ec3c3af1e3868da68623cefa60d3edd33d
author Fredrik Höglund <fredrik at kde.org> 1198787463 -0000
committer Fredrik Höglund <fredrik at kde.org> 1198787463 -0000

[snip]
svn path=/trunk/KDE/kdelibs/; revision=753567

-- 
  Thiago Macieira  -  thiago (AT) macieira.info - thiago (AT) kde.org
    PGP/GPG: 0x6EF45358; fingerprint:
    E067 918B B660 DBD1 105C  966C 33F5 F005 6EF4 5358
-------------- next part --------------
A non-text attachment was scrubbed...
Name: kde-rules-main.gz
Type: application/x-gzip
Size: 5936 bytes
Desc: not available
Url : http://mail.kde.org/pipermail/kde-scm-interest/attachments/20071228/605f2263/attachment-0001.gz 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
Url : http://mail.kde.org/pipermail/kde-scm-interest/attachments/20071228/605f2263/attachment-0001.pgp