Diff for "VcsImportRequests"

Not logged in - Log In / Register

Differences between revisions 3 and 57 (spanning 54 versions)
Revision 3 as of 2006-06-12 12:57:06
Size: 738
Editor: nor75-18-82-241-238-155
Comment:
Revision 57 as of 2006-10-16 17:08:00
Size: 14823
Editor: 218-214-66-203
Comment: Request Twisted import.
Deletions are marked like this. Additions are marked like this.
Line 4: Line 4:
 * Create a product in Launchpad and set the source details to the CVS or Subversion repository you wish to have imported.  * Create a product in Launchpad and set the source details to the CVS or Subversion repository you wish to have imported. In particular
Line 11: Line 11:
Template to request an import:

 * [https://launchpad.net/people/<launchpad-user> <launchpad-user>]: https://launchpad.net/products/<launchpad-product>/<series> [[BR]]
## Remove the backticks from the next line
   [@`DATE`@]
Line 13: Line 19:
 * mvo: please import "smart" from via svn from http://svn.smartpm.python-hosting.com/

== Open requests ==

Imports that need intervention from the vcs-imports operator.

 * [https://launchpad.net/people/spiv spiv]: https://launchpad.net/products/twisted/main [[BR]]
   [[[Date(2006-10-16T17:08:00Z)]]]


== In progress ==

Imports being processed.

 * [https://launchpad.net/people/jani janimo]: https://launchpad.net/products/xfwm4/trunk [[BR]] http://svn.xfce.org/svn/xfce/xfwm4/trunk [[BR]] [[[Date(2006-07-22T12:37:17Z)]]]

== Better REPLACE support ==

Imports that have failed and that need better support for replaced files.

 * https://launchpad.net/products/wormux/0.7 [[BR]]
   [[[Date(2006-07-22T12:18:59Z)]]]
   * On changeset 865 [[BR]]
   change: action = 'R', old kind = <node_kind.dir>, new kind = <node_kind.dir> [[BR]]
   RuntimeError: only replacing a file by a file is implemented

 * https://launchpad.net/products/opensync/trunk[[BR]]
   [[[Date(2006-07-22T12:37:17Z)]]]
   * On changeset 99 [[BR]]
   change: action = 'R', old kind = <node_kind.dir>, new kind = <node_kind.dir> [[BR]]
   RuntimeError: only replacing a file by a file is implemented

== Initial revision is a move ==

[https://launchpad.net/bugs/58029 Bug 58029].

It appears that when a svn branch is created by a move (copy + delete), the initial imported revision is empty, which causes a failure on the first revision that tries to modify a pre-existing file.

In the case of the katapult import (svn://anonsvn.kde.org/home/kde/trunk/extragear/utils/katapult), the branch is created at revision 521764 by moving from /trunk/playground/utils/katapult:521763. The initial revision of the bzr import is an empty tree.

 * [https://launchpad.net/people/mez Mez]: https://launchpad.net/products/katapult/mainstream [[BR]] svn://anonsvn.kde.org/home/kde/trunk/extragear/utils/katapult [[BR]] [[[Date(2006-08-28T15:43:43Z)]]]
   * On changeset 522145 [[BR]] 'action': 'M', 'path': u'/trunk/extragear/utils/katapult/katapult/katapult.desktop', 'copyfrom_path': None, 'copyfrom_revision': None [[BR]] RuntimeError: file katapult/katapult.desktop not present in tree

 * https://https://launchpad.net/products/bcfg2/trunk [[BR]]
   https://svn.mcs.anl.gov/repos/bcfg/trunk/bcfg2 [[BR]]
   [[[Date(2006-08-29T09:52:23Z)]]]
   * On changeset 1717 [[BR]] in write_file_breaking_links [[BR]] IOError: [Errno 2] No such file or directory

 * [https://launchpad.net/people/jaq-spacepants jaq]: https://launchpad.net/products/puppet/trunk [[BR]] http://reductivelabs.com/svn/puppet/trunk [[BR]] [[[Date(2006-07-18T22:47:35Z)]]]
   * On changeset 576 [[BR]] This is the initial revision of the branch, it is a complicated combination of renames and file modifications, consolidating a trunk branch out of multiple parts. Some of the moved files are properly imported, but one of the files which is copied _and_ modified in this revision was not imported, and causes a failure when trying to apply the modification. [[BR]] 'action': 'M', 'path': u'/trunk/test/test', 'copyfrom_path': None, 'copyfrom_revision': None [[BR]] RuntimeError: file test/test not present in tree

 * nobody: https://launchpad.net/products/tmw/trunk [[BR]] https://svn.sourceforge.net/svnroot/themanaworld/tmw/trunk [[BR]] [[[Date(2006-09-29T15:57:33Z)]]]
   * On changeset 2201 [[BR]] RuntimeError: file ChangeLog not present in tree /srv/importd.ubuntu.com/botslave/series-00001478/bzrworking, log {'action': 'M', 'path': u'/tmw/trunk/ChangeLog', 'copyfrom_path': None, 'copyfrom_revision': None}

 * nobody: https://launchpad.net/products/karra/trunk [[BR]] https://svn.sourceforge.net/svnroot/karra/trunk/karra [[BR]] [[[Date(2006-09-29T20:55:14Z)]]]
   * On changeset 917 [[BR]] IOError: [Errno 2] No such file or directory: u'/srv/importd.ubuntu.com/botslave/series-000012c3/bzrworking/locale/,,new.0.646637021358.template.po'

== Illegal file name ==

 * nobody: https://launchpad.net/products/unixodbc/main [[BR]] :pserver:anonymous`@`unixodbc.cvs.sourceforge.net:/cvsroot/unixodbc unixODBC [[BR]] [[[Date(2006-08-29T11:27:45Z)]]]
   * on changeset MAIN.1 [[BR]] The branch contains a file named `odbctest/C:\IB6TRACE.LOG` (yes, starting with `C:\`!) [[BR]] in bzrlib.workingtree.WorkingTree.add [[BR]] bzrlib.errors.NotVersionedError: ['odbctest', 'C:'] is not versioned [[BR]]


== Unknown failures ==

 * nobody: https://launchpad.net/products/xrms/trunk [[BR]] :pserver:anonymous``@xrms.cvs.sourceforge.net:/cvsroot/xrms/ xrms [[BR]] [[[Date(2006-09-29T21:20:41Z)]]]
   * on changeset MAIN.4167: [[BR]] CRITICAL: requested checkout of reporoot '/cvsroot/xrms', file 'xrms/include/adodb/pear/Attic/readme.Auth.txt', revision '1.1.1.2' [[BR]] CRITICAL: log of checkout responses follow. [[BR]] CRITICAL: "E cvs checkout: cannot find module [[BR]] `xrms/include/adodb/pear/Attic/readme.Auth.txt' - ignored\n" [[BR]] CRITICAL: 'error \n'
   * cscvs wants to create a filler changeset 1.1->1.1.1.2 for include/adodb/pear/readme.Auth.txt, but there is no revision 1.1.1.2 for that file. The cvs rlog shows revision 1.1 (branches: 1.1.1) used in changeset MAIN.915, revision 1.1.1.1, not used by cscvs. The cvs log header for that file reads "head: 1.1" and "branch: 1.1.1".

lifeless suggests:
{{{
(15:28:25) lifeless: I'd do a search in the file revision table for that file, all revisions, see what cscvs is thinking happened to it
(15:29:45) ddaa: you suggest it might be a problem in the log parser and checking the catalog contents would help narrowing the cause of the problem?
(15:33:11) lifeless: something is inventing the .2
(15:33:22) lifeless: if its in the catalog then the catalog generator can be checked
(15:33:42) lifeless: if its not in the catalog then the application-of-changesets can be checked
(15:33:45) lifeless: it will narrow it down
(15:34:03) lifeless: As its a very small rlog I'd make a test case from it
}}}

 * [[Anchor(epiphany-browser)]][https://launchpad.net/people/seb128 seb128]: https://launchpad.net/products/epiphany-browser/main [[BR]] :pserver:anonymous``@anoncvs.gnome.org:/cvs/gnome epiphany [[BR]] [[[Date(2006-10-16T14:54:17Z)]]]
   * On changeset MAIN.67 [[BR]] ValueError: attempt to patch non extant file : data/ui/epiphany-toolbar.xml.in
   * The cscvs log (with changesets) first mentions epiphany-toolbar at changeset MAIN.67, it refers to revision 1.2 of this file and records it as a 'M' (modification), which fails to apply since the file is not present in the imported tree at this point.

Relevant fragment of the cvs log:

{{{
$ cvs rlog epiphany/data\/ui/epiphany-toolbar.xml.in

RCS file: /cvs/gnome/epiphany/data/ui/Attic/epiphany-toolbar.xml.in,v
head: 1.17
branch:
locks: strict
access list:
symbolic names:
[...]
        eog-menu-api: 1.1.0.2
keyword substitution: kv
total revisions: 19; selected revisions: 19
description:
----------------------------
[...]
----------------------------
revision 1.2
date: 2003/01/20 18:57:15; author: mpeseng; state: Exp; lines: +15 -0
2003-01-20 Marco Pesenti Gritti <marco@it.gnome.org>

        * Merge eog-menu-api branch
----------------------------
revision 1.1
date: 2003/01/20 17:53:25; author: mpeseng; state: dead;
branches: 1.1.2;
file epiphany-toolbar.xml.in was initially added on branch eog-menu-api.
----------------------------
revision 1.1.2.1
date: 2003/01/20 17:53:25; author: mpeseng; state: Exp; lines: +15 -0
implement context menus
----------------------------
[...]
}}}

=== Unsorted failures ===

Imports that have failed, for an unknown reasons, and whose failure do not fall in a clear group of similar failures.

=== REPORT failed on path with bang ===

Imports that failed to do REPORT on a path with a bang. I do not know what that means, but there's clearly a pattern.

 * [https://launchpad.net/people/mvo mvo]: https://launchpad.net/products/smart/trunk [[BR]] [[[Date(2006-06-12T13:15:00Z)]]]
   * On changeset 29: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/!svn/bc/28/trunk/epm/backends' [[BR]] '/!svn/bc/28/trunk/epm/backends' path not found
     * r29 appears to include a directory move of `trunk/epm/loaders` to `trunk/epm/backends`. The `/!svn/bc/28/trunk/epm/backends` path looks like it'd refer to "`trunk/epm/backends` in r28", which didn't exist.

 * [https://launchpad.net/people/jani janimo]: https://launchpad.net/products/xfdesktop/trunk [[BR]] [[[Date(2006-06-12T13:15:00Z)]]]
   * On pysvn.Client.checkout: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/svn/xfce/!svn/bc/22073/modules/trunk/xfdesktop' [[BR]] '/svn/xfce/!svn/bc/22073/modules/trunk/xfdesktop' path not found

 * [https://launchpad.net/people/jani janimo]: https://launchpad.net/products/thunar/trunk [[BR]] [[[Date(2006-06-12T13:15:00Z)]]]
   * On changeset 18919: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/svn/xfce/!svn/bc/18918/thunar/trunk/examples/tex-open-terminal' [[BR]] '/svn/xfce/!svn/bc/18918/thunar/trunk/examples/tex-open-terminal' path not found

 * [https://launchpad.net/people/jani janimo]: https://launchpad.net/products/xfce4-session/trunk [[BR]] [[[Date(2006-07-22T12:37:17Z)]]]
   * On changeset 16234: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/svn/xfce/!svn/bc/16233/xfce4-session/trunk/xfce4-tips' [[BR]] '/svn/xfce/!svn/bc/16233/xfce4-session/trunk/xfce4-tips' path not found

 * [https://launchpad.net/people/jani janimo]: https://launchpad.net/products/xfprint4/trunk [[BR]] http://svn.xfce.org/svn/xfce/xfprint/trunk [[BR]] [[[Date(2006-08-29T15:22:13Z)]]]
   * On changeset 19953: [[BR]] REPORT request failed on '/svn/xfce/!svn/bc/19952/xfprint/trunk/libxfprint' [[BR]] '/svn/xfce/!svn/bc/19952/xfprint/trunk/libxfprint' path not found

 * nobody: https://launchpad.net/products/democracy/trunk [[BR]] https://svn.participatoryculture.org/svn/dtv/trunk/tv [[BR]] [[[Date(2006-08-29T10:15:53Z)]]]
   * On changeset 749: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/svn/dtv/!svn/bc/748/trunk/tv/platform/osx/Resources-DMG' [[BR]] '/svn/dtv/!svn/bc/748/trunk/tv/platform/osx/Resources-DMG' path not found

 * [https://launchpad.net/people/dsnopek dsnopek]: https://launchpad.net/products/dojo/trunk [[BR]] http://svn.dojotoolkit.org/dojo/trunk [[BR]] [[[Date(2006-08-31T20:10:43Z)]]]
   * On changeset 1310: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/dojo/!svn/bc/1309/trunk/buildscripts' [[BR]] '/dojo/!svn/bc/1309/trunk/buildscripts' path not found

 * nobody: https://launchpad.net/products/norfellocmms/trunk [[BR]] http://cmms.norfello.com/svn/cmms/trunk [[BR]] [[[Date(2006-09-14T13:38:35Z)]]]
   * On changeset 121: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/svn/cmms/!svn/bc/120/trunk/app/views/keyring' [[BR]] '/svn/cmms/!svn/bc/120/trunk/app/views/keyring' path not found

 * [https://launchpad.net/people/jr Riddel]: https://launchpad.net/products/ubuntu-doc/trunk [[BR]] https://docteam.ubuntu.com/repos/trunk [[BR]] [[[Date(2006-09-22T13:56:13Z)]]]
   * On changeset 940: [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/repos/!svn/bc/939/trunk/kde' [[BR]] '/repos/!svn/bc/939/trunk/kde' path not found

 * nobody: https://launchpad.net/products/libflaim/trunk [[BR]] https://forgesvn1.novell.com/svn/flaim/trunk [[BR]] [[[Date(2006-09-29T20:03:56Z)]]]
   * On changeset 828 [[BR]] pysvn._pysvn.ClientError: REPORT request failed on '/svn/flaim/!svn/bc/827/trunk/xflaim/java/util/xxedit/xedit' [[BR]] '/svn/flaim/!svn/bc/827/trunk/xflaim/java/util/xxedit/xedit' path not found

=== Tried to get inexistant previous revision ===

Imports that failed on changeset N while trying to access revision N-1 for a file, because that file does not exist in revision N-1.

 * [https://launchpad.net/people/kamion kamion]: https://launchpad.net/products/debian-installer/main [[BR]]
   [[[Date(2006-06-27T11:48:50Z)]]]
   * On changeset 16118: [[BR]] pysvn._pysvn.ClientError: File not found: revision 16117, path '/trunk/installer/build/config/amd64'

 * [https://launchpad.net/people/kamion kamion]: https://launchpad.net/products/lowmem/main [[BR]]
   [[[Date(2006-07-03T10:33:08Z)]]]
   * On changeset 19199: [[BR]] pysvn._pysvn.ClientError: File not found: revision 19198, path '/trunk/packages/lowmem/debian-installer-startup.d'

 * [https://launchpad.net/people/kamion kamion]: https://launchpad.net/products/partman-auto/trunk [[BR]]
   [[[Date(2006-07-03T10:41:39Z)]]]
   * On changeset 19021: [[BR]] pysvn._pysvn.ClientError: File not found: revision 19020, path '/trunk/packages/partman/partman-auto/recipes-mipsel-sb1-swarm-bn'

 * nobody: https://launchpad.net/products/elgg/trunk [[BR]] svn://elgg.net/elgg/devel [[BR]] [[[Date(2006-09-29T16:04:15Z)]]]
   * On changeset 421: [[BR]] pysvn._pysvn.ClientError: File not found: revision 420, path '/devel/lib/phpthumb'


=== Failed to fork, memory error ===

Some large imports fail to os.fork() (when spawning gpg to sign a revision) with "OSError: [Errno 12] Cannot allocate memory". It's not clear why that happen, since Linux should overcommit memory up to 50x (the value of /proc/sys/vm/overcommit_ratio) and allow large processes like cscvs to spawn small processes like gpg.

 * [https://launchpad.net/people/siretart siretart]: https://launchpad.net/products/mplayer/trunk [[BR]] svn://svn.mplayerhq.hu/mplayer/trunk [[BR]] [[[Date(2006-06-12T13:15:00Z)]]]
   * On changeset changeset 5343

 * [https://launchpad.net/people/jbailey jbailey]: https://launchpad.net/products/glibc/head [[BR]] :pserver:anoncvs`@`sources.redhat.com:/cvs/glibc glibc [[BR]] [[[Date(2006-08-29T10:36:24Z)]]]
   * On changeset MAIN.15819

 * [https://launchpad.net/people/carlos]: https://launchpad.net/products/elisa/trunk [[BR]] https://core.fluendo.com/elisa/svn/trunk [[BR]] [[[Date(2006-09-06T09:43:12Z)]]]
   * On changeset 7

This page tracks requests for actions from the vcs-imports operator.

To request an import, please:

  • Create a product in Launchpad and set the source details to the CVS or Subversion repository you wish to have imported. In particular
  • Add a request on this page, with the name of your launchpad account so I can find your email.

Note that we only do imports of MAIN branches on CVS (the form will have to be updated to remove the "branch" field) and trunk branches on Subversion.

We will handle your request and keep you informed of progress or issues. You can contact the vcs-imports operator: ddaa in #launchpad on irc.freenode.net.

Template to request an import:

  • [@DATE@]


Open requests

Imports that need intervention from the vcs-imports operator.

In progress

Imports being processed.

Better REPLACE support

Imports that have failed and that need better support for replaced files.

Initial revision is a move

[https://launchpad.net/bugs/58029 Bug 58029].

It appears that when a svn branch is created by a move (copy + delete), the initial imported revision is empty, which causes a failure on the first revision that tries to modify a pre-existing file.

In the case of the katapult import (svn://anonsvn.kde.org/home/kde/trunk/extragear/utils/katapult), the branch is created at revision 521764 by moving from /trunk/playground/utils/katapult:521763. The initial revision of the bzr import is an empty tree.

Illegal file name

Unknown failures

  • nobody: https://launchpad.net/products/xrms/trunk BR :pserver:anonymous@xrms.cvs.sourceforge.net:/cvsroot/xrms/ xrms BR [Date(2006-09-29T21:20:41Z)]

    • on changeset MAIN.4167: BR CRITICAL: requested checkout of reporoot '/cvsroot/xrms', file 'xrms/include/adodb/pear/Attic/readme.Auth.txt', revision '1.1.1.2' BR CRITICAL: log of checkout responses follow. BR CRITICAL: "E cvs checkout: cannot find module BR `xrms/include/adodb/pear/Attic/readme.Auth.txt' - ignored\n" BR CRITICAL: 'error \n'

    • cscvs wants to create a filler changeset 1.1->1.1.1.2 for include/adodb/pear/readme.Auth.txt, but there is no revision 1.1.1.2 for that file. The cvs rlog shows revision 1.1 (branches: 1.1.1) used in changeset MAIN.915, revision 1.1.1.1, not used by cscvs. The cvs log header for that file reads "head: 1.1" and "branch: 1.1.1".

lifeless suggests:

(15:28:25) lifeless: I'd do a search in the file revision table for that file, all revisions, see what cscvs is thinking happened to it
(15:29:45) ddaa: you suggest it might be a problem in the log parser and checking the catalog contents would help narrowing the cause of the problem?
(15:33:11) lifeless: something is inventing the .2
(15:33:22) lifeless: if its in the catalog then the catalog generator can be checked
(15:33:42) lifeless: if its not in the catalog then the application-of-changesets can be checked
(15:33:45) lifeless: it will narrow it down
(15:34:03) lifeless: As its a very small rlog I'd make a test case from it

Relevant fragment of the cvs log:

$ cvs rlog epiphany/data\/ui/epiphany-toolbar.xml.in

RCS file: /cvs/gnome/epiphany/data/ui/Attic/epiphany-toolbar.xml.in,v
head: 1.17
branch:
locks: strict
access list:
symbolic names:
[...]
        eog-menu-api: 1.1.0.2
keyword substitution: kv
total revisions: 19;    selected revisions: 19
description:
----------------------------
[...]
----------------------------
revision 1.2
date: 2003/01/20 18:57:15;  author: mpeseng;  state: Exp;  lines: +15 -0
2003-01-20  Marco Pesenti Gritti  <marco@it.gnome.org>

        * Merge eog-menu-api branch
----------------------------
revision 1.1
date: 2003/01/20 17:53:25;  author: mpeseng;  state: dead;
branches:  1.1.2;
file epiphany-toolbar.xml.in was initially added on branch eog-menu-api.
----------------------------
revision 1.1.2.1
date: 2003/01/20 17:53:25;  author: mpeseng;  state: Exp;  lines: +15 -0
implement context menus
----------------------------
[...]

Unsorted failures

Imports that have failed, for an unknown reasons, and whose failure do not fall in a clear group of similar failures.

REPORT failed on path with bang

Imports that failed to do REPORT on a path with a bang. I do not know what that means, but there's clearly a pattern.

Tried to get inexistant previous revision

Imports that failed on changeset N while trying to access revision N-1 for a file, because that file does not exist in revision N-1.

Failed to fork, memory error

Some large imports fail to os.fork() (when spawning gpg to sign a revision) with "OSError: [Errno 12] Cannot allocate memory". It's not clear why that happen, since Linux should overcommit memory up to 50x (the value of /proc/sys/vm/overcommit_ratio) and allow large processes like cscvs to spawn small processes like gpg.

VcsImportRequests (last edited 2021-05-27 14:19:59 by cjwatson)