[dw-free] Importing of comments from big journals fails with truncated content

[fu]

[commit: http://hg.dwscoalition.org/dw-free/rev/f310efdb82bb]

http://bugs.dwscoalition.org/show_bug.cgi?id=3575

Request less data at a time, to reduce risk of timing out.

Patch by fu.

Files modified:

• cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm

--------------------------------------------------------------------------------
diff -r 7d0e96a81750 -r f310efdb82bb cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
--- a/cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm	Mon Mar 28 16:27:10 2011 +0800
+++ b/cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm	Mon Mar 28 16:31:21 2011 +0800
@@ -26,7 +26,7 @@ use DW::Worker::ContentImporter::Local::
 
 # these come from LJ
 our $COMMENTS_FETCH_META = 10000;
-our $COMMENTS_FETCH_BODY = 1000;
+our $COMMENTS_FETCH_BODY = 500;
 
 sub work {
 
--------------------------------------------------------------------------------

Comments

[yvi]

Ohh, I hope this works.