github: shadowy octopus with the head of a robot, emblazoned with the Dreamwidth swirl (Default)
github ([personal profile] github) wrote in [site community profile] changelog2013-02-14 06:39 pm

[dreamwidth/dw-free] 8c8031: Add source data to copier jobs

Branch: refs/heads/release-1.13
Home: https://github.com/dreamwidth/dw-free
Commit: 8c8031bc4ff897e77b227a1085011664e582b46a
https://github.com/dreamwidth/dw-free/commit/8c8031bc4ff897e77b227a1085011664e582b46a
Author: Mark Smith <mark@bu.mp>
Date: 2013-02-14 (Thu, 14 Feb 2013)

Changed paths:
M bin/schedule-copier-jobs
M cgi-bin/DW/Hooks/SiteSearch.pm
M cgi-bin/DW/Pay.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
M cgi-bin/LJ/Entry.pm
M cgi-bin/LJ/Protocol.pm
M cgi-bin/LJ/Talk.pm

Log Message:
-----------
Add source data to copier jobs

This allows us to track where a copy job was scheduled from.

Patch by [personal profile] fu.


Commit: ae9f449a3e5796f9719ba50a8825d08b52fd783d
https://github.com/dreamwidth/dw-free/commit/ae9f449a3e5796f9719ba50a8825d08b52fd783d
Author: Mark Smith <mark@bu.mp>
Date: 2013-02-14 (Thu, 14 Feb 2013)

Changed paths:
M bin/worker/sphinx-copier

Log Message:
-----------
Optimize the sphinx copier

The copier is now resilient and efficient against journals with huge
numbers of comments. It's slightly less efficient with huge numbers of
entries, but it still seems to work fine for all of DW's accounts.

Thanks to [community profile] cfud and [community profile] sixwordstories for making
this necessary. :-)


Compare: https://github.com/dreamwidth/dw-free/compare/8ff5e4f53c44...ae9f449a3e57