Mar. 13th, 2012

mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark
[commit: http://hg.dwscoalition.org/dw-free/rev/3c01c3ea5414]

Switch from syncitems to multiple getevents in entry imports

We were having some issues with syncitems failing on large accounts. Also,
honestly, it's really a finicky system and hard to use correctly. I decided
to rip it out and replace it with the a more straightforward approach.

Now, we use the selecttype of 'one' and the itemid of -1 to fetch the most
recent entry. Since itemids will be monotonically increasing, this gives us
an upper bound on the range. Since we also know that every account starts at
itemid 1, that gives us a lower bound.

From there it is a simple matter to start requesting entries in groups of
100. This is far more efficient -- for both us and the remote side -- than
using syncitems.

(The reason that we can do this is because we never go back and edit posts.
The strength of the syncitems mode is that it supports downloading edited
versions of the post.)

Patch by [staff profile] mark.

Files modified:
  • cgi-bin/DW/Worker/ContentImporter.pm
  • cgi-bin/DW/Worker/ContentImporter/LiveJournal/Entries.pm
  • cgi-bin/DW/Worker/ContentImporter/Local/Entries.pm
Diff: 3 files changed. )
fu: Close-up of Fu, bringing a scoop of water to her mouth (Default)
[personal profile] fu
[commit: http://hg.dwscoalition.org/dw-free/rev/52f1f972f400]

http://bugs.dwscoalition.org/show_bug.cgi?id=4365

Stay put until the user does something, like move their mouse, at which
point dismiss after a brief period.

Patch by [personal profile] fu.

Files modified:
  • htdocs/js/jquery.ajaxtip.js
  • htdocs/js/jquery.contextualhover.js
Diff: 2 files changed. )
fu: Close-up of Fu, bringing a scoop of water to her mouth (Default)
[personal profile] fu
[commit: http://hg.dwscoalition.org/dw-free/rev/9970a9c7dc2f]

http://bugs.dwscoalition.org/show_bug.cgi?id=3673

jQuerify the tracking popup bits of esn.js, so we can have inline tracking
in s2 journal views. This also makes the (jquerified) ESN javascript only be
loaded onto the page if we need it, not everywhere.

Patch by [personal profile] fu based on work by [personal profile] yvi.

Files modified:
  • cgi-bin/LJ/S2.pm
  • cgi-bin/LJ/S2/EntryPage.pm
  • cgi-bin/LJ/S2/FriendsPage.pm
  • cgi-bin/LJ/S2/RecentPage.pm
  • cgi-bin/LJ/S2/ReplyPage.pm
  • htdocs/js/dw/dw-core.js
  • htdocs/js/jquery.ajaxtip.js
  • htdocs/js/jquery.esn.js
  • htdocs/stc/esn.css
Diff: 9 files changed. )
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark
[commit: http://hg.dwscoalition.org/dw-free/rev/82baebb440e9]

Fix some user remapping

If someone had an LJ user tag with a trailing slash that did not have
quotes, we would include the slash in the username. No more, I say! This
will fix some issues with importing entries ending up with bad tags.

Patch by [staff profile] mark.

Files modified:
  • cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm
Diff: 1 file changed. )
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark
[commit: http://hg.dwscoalition.org/dw-free/rev/40848a3f33dc]

Fix UI for community imports

The import status widget didn't mention the community that was being
imported. This should be more clear, although still not ideal. (It should
have user tags with the heads etc.)

Patch by [staff profile] mark.

Files modified:
  • bin/upgrading/en.dat
  • cgi-bin/LJ/Widget/ImportStatus.pm
Diff: 2 files changed. )
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark
[commit: http://hg.dwscoalition.org/dw-free/rev/906a190f66f5]

Don't backdate community posts when importing

We use the backdate option so that posts you import don't flood your reading
page. It turns out that this is unnecessary for community posts because we
manually set the logtime/rlogtime to an old value. This means we can turn
off backdate and we won't flood the reading pages.

Patch by [staff profile] mark.

Files modified:
  • cgi-bin/DW/Worker/ContentImporter/Local/Entries.pm
Diff: 1 file changed. )
mark: A photo of Mark kneeling on top of the Taal Volcano in the Philippines. It was a long hike. (Default)
[staff profile] mark
[commit: http://hg.dwscoalition.org/dw-free/rev/7e75b63eb1d9]

Comment importer should exit to reclaim memory

Patch by [staff profile] mark.

Files modified:
  • cgi-bin/DW/Worker/ContentImporter/LiveJournal/Comments.pm
Diff: 1 file changed. )

Profile

Dreamwidth Changelog

May 2026

S M T W T F S
     12
3456789
10111213141516
1718192021 22 23
24 25 2627282930
31      

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated May. 26th, 2026 11:40 pm
Powered by Dreamwidth Studios