Home_greyopenFATE - openSUSE feature tracking > #309167
Dashboard | Search | Sign up | Login

Please login or register to be able to edit or vote this feature.

lzma compression for primary.xml

Feature state

Buildservice
Rejected Information
openSUSE-11.3
Rejected Information

Description

Providing all exported kernel symbols as individual dependencies (Fate #305945) resulted in a DoS against download.o.o, because the primary.xml.gz file in the update repository grows with each kernel update (Bug #582907 and 586960). The least intrusive fix to this seems to be: Sort the entries in primary.xml and provide a lzma compressed version in addition to primary.xml.gz. Testing shows that this brings the metadata growth back to the 11.1 symset approach (about 100k for each subsequent kernel update) and also reduces the size, so it would be beneficial also for normal repositories. The repomd.xml format extension could look like:

<data type="primary"> 
<location href="repodata/primary.xml.gz"/>
<checksum type="sha">1233456...</checksum>
<timestamp>1268305225</timestamp>
<open-checksum type="sha">abcdef...</open-checksum>
</data>
<data type="primary-lzma">
<location href="repodata/primary.xml.lzma"/>
<checksum type="sha">56789a...</checksum>
<timestamp>1268305245</timestamp>
<open-checksum type="sha">abcdef...</open-checksum>
</data>

With the meaning that if there is a primary.xml.lzma with the same open-checksum, download this one instead of primary.xml.gz, decompress it with lzma (in default install since 11.1) and then continue as usual. Old clients would continue working with the primary.xml.gz file. The feature primarily targets libzypp, but also extending yum should not be hard.

Relations

Discussion


icons/user_comment.png M. M. wrote: (8 years ago)

patches for createrepo: http://gitorious.org/mmarek-misc/createrepo/commits/lzma-support
libzypp patches: http://gitorious.org/~mmarek/opensuse/libzypp-lzma/commits/lzma-support
sat-solver patches: http://gitorious.org/~mmarek/opensuse/sat-solver-lzma/commits/lzma-support

createrepo is submitted to system:packagemanager as sr #39243. Libzypp and sat-solver patches were posted to the zypp-devel mailing list:
http://lists.opensuse.org/zypp-devel/2010-05/msg00005.html .

icons/user_comment.png J. E. wrote: (7 years ago)

Should use xz these days.

Last change: 7 years ago
Voting
Score: 1
  • Negative: 0
  • Neutral: 1
  • Positive: 1
Tags
Feature Export
Application-xmlXML   Text-x-logPlaintext   PrinterPrint