![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
![[site community profile]](https://www.dreamwidth.org/img/comm_staff.png){kind=small}
[dreamwidth/dw-free] 4d2fe1: Reversed the logic for logging this statement. Oop...
Branch: refs/heads/develop
Home: https://github.com/dreamwidth/dw-free
Commit: 4d2fe1989d0629d2053645532057ea3f01c7d884
https://github.com/dreamwidth/dw-free/commit/4d2fe1989d0629d2053645532057ea3f01c7d884
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-01 (Fri, 01 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
Log Message:
-----------
Reversed the logic for logging this statement. Oops
Commit: e33837565d2cfafe93b6bfe3ed063fd11796e1f4
https://github.com/dreamwidth/dw-free/commit/e33837565d2cfafe93b6bfe3ed063fd11796e1f4
Author: Afuna <afunamatata+github@gmail.com>
Date: 2013-02-06 (Wed, 06 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
Log Message:
-----------
Merge pull request #248 from afuna/fix-logging
Reversed the logic for logging this statement. Oops
Commit: 0a0e7e854207f89169dad9bb11813efb11e24d56
https://github.com/dreamwidth/dw-free/commit/0a0e7e854207f89169dad9bb11813efb11e24d56
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-06 (Wed, 06 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
(Bug 4855) Get the first non-DOOO entry when importing
Getting the latest entry via the protocol gives us the latest entry
according to eventtime (user-provided time) rather than logtime.
Sometimse this could be a DOOO entry, which then means that everything
after that DOOO entry will not be imported. So let's try to find the
first non-DOOO entry, as that will be the latest according to logtime.
Commit: 7974fba292388687f5f12fedba7155d3bdc69fe0
https://github.com/dreamwidth/dw-free/commit/7974fba292388687f5f12fedba7155d3bdc69fe0
Author: Afuna <afunamatata+github@gmail.com>
Date: 2013-02-06 (Wed, 06 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
Merge pull request #249 from afuna/import-dooo-first-entry-bug4855
(Bug 4855) Get the first non-DOOO entry when importing
Commit: 107776b66630002cb2e42a7dd78039a4a5a4dd4f
https://github.com/dreamwidth/dw-free/commit/107776b66630002cb2e42a7dd78039a4a5a4dd4f
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-07 (Thu, 07 Feb 2013)
Changed paths:
M bin/schedule-copier-jobs
M bin/worker/content-importer
M bin/worker/content-importer-lite
M bin/worker/content-importer-verify
M bin/worker/import-scheduler
M bin/worker/sphinx-copier
M bin/worker/sphinx-search-gm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
M cgi-bin/LJ/DB.pm
M cgi-bin/LJ/Protocol.pm
M cgi-bin/LJ/Talk.pm
M htdocs/search.bml
M htdocs/search.bml.text
Log Message:
-----------
Sphinx improvements, comment indexing
Performance improvements:
* Do not use AUTO_INCREMENT, use a better PRIMARY KEY that InnoDB that
reflects the data access patterns. (All accesses are either single-items
or groups-by-journal.)
* Use COMPRESS to save disk space.
* Don't copy entire journals every time something updates.
* Only copy once when imported -- at the end.
Functionality improvements:
* Add comment indexing and searching.
* Support delta indices for faster indexing cycles.
IMPORTANT: These changes are backwards-incompatible with search
installations. If you deploy this code, you will need to update
your database schema and delete the table and reimport (to get the
compression).
Commit: d3351fa940ae9cdfc37ddc2ce09599d06c2b9ab6
https://github.com/dreamwidth/dw-free/commit/d3351fa940ae9cdfc37ddc2ce09599d06c2b9ab6
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-07 (Thu, 07 Feb 2013)
Changed paths:
M bin/worker/sphinx-copier
Log Message:
-----------
Make sphinx-copier status-line readable
Commit: bbfce05fa911715f5dc0b55d8c826bc353c7dee9
https://github.com/dreamwidth/dw-free/commit/bbfce05fa911715f5dc0b55d8c826bc353c7dee9
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-07 (Thu, 07 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm
Log Message:
-----------
Fix case where OpenIDs get underscores
URLs should have dashes. This is one case where that happens.
Commit: 6e75c71fbebf8c92bc6d0cbd74ccf172500bc9df
https://github.com/dreamwidth/dw-free/commit/6e75c71fbebf8c92bc6d0cbd74ccf172500bc9df
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-08 (Fri, 08 Feb 2013)
Changed paths:
M cgi-bin/DW/Hooks/SiteSearch.pm
M cgi-bin/LJ/DB.pm
Log Message:
-----------
Fix miscellaneous Sphinx DB usage
These two codepaths use the Sphinx DB. The table changed.
Commit: ea82f4737027e837f18d94e6463d1a0af9b37c96
https://github.com/dreamwidth/dw-free/commit/ea82f4737027e837f18d94e6463d1a0af9b37c96
Author: Robby Griffin <alierak@gmail.com>
Date: 2013-02-09 (Sat, 09 Feb 2013)
Changed paths:
M cgi-bin/DW/Hooks/SiteSearch.pm
Log Message:
-----------
(Bug 4871) rename search column journal_id to journalid
Commit: 47506a94c0be6d2d186375194e3a916b7c431998
https://github.com/dreamwidth/dw-free/commit/47506a94c0be6d2d186375194e3a916b7c431998
Author: alierak <alierak@gmail.com>
Date: 2013-02-09 (Sat, 09 Feb 2013)
Changed paths:
M cgi-bin/DW/Hooks/SiteSearch.pm
Log Message:
-----------
Merge pull request #251 from alierak/searchdb-bug4871
(Bug 4871) rename search column journal_id to journalid
Commit: 9e31b737f3d7fba502837b0fc77960c5927bc646
https://github.com/dreamwidth/dw-free/commit/9e31b737f3d7fba502837b0fc77960c5927bc646
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-11 (Mon, 11 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
(Bug 4855) Do not proceed when we fail
When we fail, cut it short. Don't continue.
Commit: 8ff5e4f53c44629fc277a85d70b94dcb0da7b6bd
https://github.com/dreamwidth/dw-free/commit/8ff5e4f53c44629fc277a85d70b94dcb0da7b6bd
Author: Afuna <afunamatata+github@gmail.com>
Date: 2013-02-12 (Tue, 12 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
Merge pull request #261 from afuna/fail-return-bug4855
(Bug 4855) Do not proceed when we fail
Commit: 3d262af154c92dcb7599bca65f4625529ecc71d5
https://github.com/dreamwidth/dw-free/commit/3d262af154c92dcb7599bca65f4625529ecc71d5
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-12 (Tue, 12 Feb 2013)
Changed paths:
M bin/schedule-copier-jobs
M bin/worker/content-importer
M bin/worker/content-importer-lite
M bin/worker/content-importer-verify
M bin/worker/import-scheduler
M bin/worker/sphinx-copier
M bin/worker/sphinx-search-gm
M cgi-bin/DW/Hooks/SiteSearch.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
M cgi-bin/LJ/DB.pm
M cgi-bin/LJ/Protocol.pm
M cgi-bin/LJ/Talk.pm
M htdocs/search.bml
M htdocs/search.bml.text
Log Message:
-----------
Merge branch 'release-1.13' into develop
* release-1.13:
(Bug 4855) Do not proceed when we fail
(Bug 4871) rename search column journal_id to journalid
Fix miscellaneous Sphinx DB usage
Fix case where OpenIDs get underscores
Make sphinx-copier status-line readable
Sphinx improvements, comment indexing
(Bug 4855) Get the first non-DOOO entry when importing
Reversed the logic for logging this statement. Oops
Compare: https://github.com/dreamwidth/dw-free/compare/3806d918d248...3d262af154c9
Home: https://github.com/dreamwidth/dw-free
Commit: 4d2fe1989d0629d2053645532057ea3f01c7d884
https://github.com/dreamwidth/dw-free/commit/4d2fe1989d0629d2053645532057ea3f01c7d884
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-01 (Fri, 01 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
Log Message:
-----------
Reversed the logic for logging this statement. Oops
Commit: e33837565d2cfafe93b6bfe3ed063fd11796e1f4
https://github.com/dreamwidth/dw-free/commit/e33837565d2cfafe93b6bfe3ed063fd11796e1f4
Author: Afuna <afunamatata+github@gmail.com>
Date: 2013-02-06 (Wed, 06 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
Log Message:
-----------
Merge pull request #248 from afuna/fix-logging
Reversed the logic for logging this statement. Oops
Commit: 0a0e7e854207f89169dad9bb11813efb11e24d56
https://github.com/dreamwidth/dw-free/commit/0a0e7e854207f89169dad9bb11813efb11e24d56
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-06 (Wed, 06 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
(Bug 4855) Get the first non-DOOO entry when importing
Getting the latest entry via the protocol gives us the latest entry
according to eventtime (user-provided time) rather than logtime.
Sometimse this could be a DOOO entry, which then means that everything
after that DOOO entry will not be imported. So let's try to find the
first non-DOOO entry, as that will be the latest according to logtime.
Commit: 7974fba292388687f5f12fedba7155d3bdc69fe0
https://github.com/dreamwidth/dw-free/commit/7974fba292388687f5f12fedba7155d3bdc69fe0
Author: Afuna <afunamatata+github@gmail.com>
Date: 2013-02-06 (Wed, 06 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
Merge pull request #249 from afuna/import-dooo-first-entry-bug4855
(Bug 4855) Get the first non-DOOO entry when importing
Commit: 107776b66630002cb2e42a7dd78039a4a5a4dd4f
https://github.com/dreamwidth/dw-free/commit/107776b66630002cb2e42a7dd78039a4a5a4dd4f
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-07 (Thu, 07 Feb 2013)
Changed paths:
M bin/schedule-copier-jobs
M bin/worker/content-importer
M bin/worker/content-importer-lite
M bin/worker/content-importer-verify
M bin/worker/import-scheduler
M bin/worker/sphinx-copier
M bin/worker/sphinx-search-gm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
M cgi-bin/LJ/DB.pm
M cgi-bin/LJ/Protocol.pm
M cgi-bin/LJ/Talk.pm
M htdocs/search.bml
M htdocs/search.bml.text
Log Message:
-----------
Sphinx improvements, comment indexing
Performance improvements:
* Do not use AUTO_INCREMENT, use a better PRIMARY KEY that InnoDB that
reflects the data access patterns. (All accesses are either single-items
or groups-by-journal.)
* Use COMPRESS to save disk space.
* Don't copy entire journals every time something updates.
* Only copy once when imported -- at the end.
Functionality improvements:
* Add comment indexing and searching.
* Support delta indices for faster indexing cycles.
IMPORTANT: These changes are backwards-incompatible with search
installations. If you deploy this code, you will need to update
your database schema and delete the table and reimport (to get the
compression).
Commit: d3351fa940ae9cdfc37ddc2ce09599d06c2b9ab6
https://github.com/dreamwidth/dw-free/commit/d3351fa940ae9cdfc37ddc2ce09599d06c2b9ab6
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-07 (Thu, 07 Feb 2013)
Changed paths:
M bin/worker/sphinx-copier
Log Message:
-----------
Make sphinx-copier status-line readable
Commit: bbfce05fa911715f5dc0b55d8c826bc353c7dee9
https://github.com/dreamwidth/dw-free/commit/bbfce05fa911715f5dc0b55d8c826bc353c7dee9
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-07 (Thu, 07 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm
Log Message:
-----------
Fix case where OpenIDs get underscores
URLs should have dashes. This is one case where that happens.
Commit: 6e75c71fbebf8c92bc6d0cbd74ccf172500bc9df
https://github.com/dreamwidth/dw-free/commit/6e75c71fbebf8c92bc6d0cbd74ccf172500bc9df
Author: Mark Smith <mark@dreamwidth.org>
Date: 2013-02-08 (Fri, 08 Feb 2013)
Changed paths:
M cgi-bin/DW/Hooks/SiteSearch.pm
M cgi-bin/LJ/DB.pm
Log Message:
-----------
Fix miscellaneous Sphinx DB usage
These two codepaths use the Sphinx DB. The table changed.
Commit: ea82f4737027e837f18d94e6463d1a0af9b37c96
https://github.com/dreamwidth/dw-free/commit/ea82f4737027e837f18d94e6463d1a0af9b37c96
Author: Robby Griffin <alierak@gmail.com>
Date: 2013-02-09 (Sat, 09 Feb 2013)
Changed paths:
M cgi-bin/DW/Hooks/SiteSearch.pm
Log Message:
-----------
(Bug 4871) rename search column journal_id to journalid
Commit: 47506a94c0be6d2d186375194e3a916b7c431998
https://github.com/dreamwidth/dw-free/commit/47506a94c0be6d2d186375194e3a916b7c431998
Author: alierak <alierak@gmail.com>
Date: 2013-02-09 (Sat, 09 Feb 2013)
Changed paths:
M cgi-bin/DW/Hooks/SiteSearch.pm
Log Message:
-----------
Merge pull request #251 from alierak/searchdb-bug4871
(Bug 4871) rename search column journal_id to journalid
Commit: 9e31b737f3d7fba502837b0fc77960c5927bc646
https://github.com/dreamwidth/dw-free/commit/9e31b737f3d7fba502837b0fc77960c5927bc646
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-11 (Mon, 11 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
(Bug 4855) Do not proceed when we fail
When we fail, cut it short. Don't continue.
Commit: 8ff5e4f53c44629fc277a85d70b94dcb0da7b6bd
https://github.com/dreamwidth/dw-free/commit/8ff5e4f53c44629fc277a85d70b94dcb0da7b6bd
Author: Afuna <afunamatata+github@gmail.com>
Date: 2013-02-12 (Tue, 12 Feb 2013)
Changed paths:
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
Log Message:
-----------
Merge pull request #261 from afuna/fail-return-bug4855
(Bug 4855) Do not proceed when we fail
Commit: 3d262af154c92dcb7599bca65f4625529ecc71d5
https://github.com/dreamwidth/dw-free/commit/3d262af154c92dcb7599bca65f4625529ecc71d5
Author: Afuna <fu@dreamwidth.org>
Date: 2013-02-12 (Tue, 12 Feb 2013)
Changed paths:
M bin/schedule-copier-jobs
M bin/worker/content-importer
M bin/worker/content-importer-lite
M bin/worker/content-importer-verify
M bin/worker/import-scheduler
M bin/worker/sphinx-copier
M bin/worker/sphinx-search-gm
M cgi-bin/DW/Hooks/SiteSearch.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
M cgi-bin/LJ/DB.pm
M cgi-bin/LJ/Protocol.pm
M cgi-bin/LJ/Talk.pm
M htdocs/search.bml
M htdocs/search.bml.text
Log Message:
-----------
Merge branch 'release-1.13' into develop
* release-1.13:
(Bug 4855) Do not proceed when we fail
(Bug 4871) rename search column journal_id to journalid
Fix miscellaneous Sphinx DB usage
Fix case where OpenIDs get underscores
Make sphinx-copier status-line readable
Sphinx improvements, comment indexing
(Bug 4855) Get the first non-DOOO entry when importing
Reversed the logic for logging this statement. Oops
Compare: https://github.com/dreamwidth/dw-free/compare/3806d918d248...3d262af154c9