fu: Close-up of Fu, bringing a scoop of water to her mouth (Default)
fu ([personal profile] fu) wrote in [site community profile] changelog2011-03-28 08:32 am

[dw-free] Importing of comments from big journals fails with truncated content

[commit: http://hg.dwscoalition.org/dw-free/rev/f310efdb82bb]

http://bugs.dwscoalition.org/show_bug.cgi?id=3575

Request less data at a time, to reduce risk of timing out.

Patch by [personal profile] fu.

Files modified:
  • cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
--------------------------------------------------------------------------------
diff -r 7d0e96a81750 -r f310efdb82bb cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
--- a/cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm	Mon Mar 28 16:27:10 2011 +0800
+++ b/cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm	Mon Mar 28 16:31:21 2011 +0800
@@ -26,7 +26,7 @@ use DW::Worker::ContentImporter::Local::
 
 # these come from LJ
 our $COMMENTS_FETCH_META = 10000;
-our $COMMENTS_FETCH_BODY = 1000;
+our $COMMENTS_FETCH_BODY = 500;
 
 sub work {
 
--------------------------------------------------------------------------------

Post a comment in response:

This account has disabled anonymous posting.
If you don't have an account you can create one now.
HTML doesn't work in the subject.
More info about formatting

If you are unable to use this captcha for any reason, please contact us by email at support@dreamwidth.org