[dreamwidth/dw-free] 0c0e6c: Start BlobStore

[github]

Branch: refs/heads/develop
Home: https://github.com/dreamwidth/dw-free
Commit: 0c0e6c626e6f3bfb538db82608aa31d4e37a8cb6
https://github.com/dreamwidth/dw-free/commit/0c0e6c626e6f3bfb538db82608aa31d4e37a8cb6
Author: Mark Smith <mark@dreamwidth.org>
Date: 2017-02-08 (Wed, 08 Feb 2017)

Changed paths:
M bin/checkconfig.pl
M bin/delete-bogus-media.pl
M bin/incoming-mail-inject.pl
M bin/maint/clean_caches.pl
R bin/upgrading/migrate-userpics.pl
M bin/upgrading/update-db-general.pl
M bin/upgrading/update-db.pl
M bin/worker/incoming-email
R bin/worker/userpic-resize-gm
M cgi-bin/Apache/LiveJournal.pm
A cgi-bin/DW/BlobStore.pm
A cgi-bin/DW/BlobStore/LocalDisk.pm
A cgi-bin/DW/BlobStore/MogileFS.pm
A cgi-bin/DW/BlobStore/S3.pm
M cgi-bin/DW/Controller/API/Media.pm
A cgi-bin/DW/Controller/EditIcons.pm
M cgi-bin/DW/Controller/Media.pm
M cgi-bin/DW/Controller/RPC/MiscLegacy.pm
M cgi-bin/DW/EmailPost/Entry.pm
M cgi-bin/DW/Media.pm
M cgi-bin/DW/Media/Base.pm
M cgi-bin/DW/Media/Photo.pm
M cgi-bin/DW/VirtualGift.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Userpics.pm
M cgi-bin/DW/Worker/ContentImporter/UserPictures.pm
M cgi-bin/LJ/ConfCheck/General.pm
M cgi-bin/LJ/Config.pm
M cgi-bin/LJ/Directory/Constraint.pm
M cgi-bin/LJ/Directory/SetHandle/Mogile.pm
R cgi-bin/LJ/IncomingEmailHandle.pm
M cgi-bin/LJ/User/Account.pm
M cgi-bin/LJ/User/Icons.pm
M cgi-bin/LJ/Userpic.pm
M cgi-bin/ljlib.pl
M cgi-bin/modperl_subs.pl
M etc/config-private.pl
M etc/config.pl
A etc/log4perl.conf
M etc/workers.conf
M htdocs/admin/vgifts/index.bml
M htdocs/editicons.bml
M htdocs/tools/userpicfactory.bml
M t/aliases.t
A t/blobstore.t
M t/directorysearch.t
M t/media-security.t

Log Message:
-----------
Start BlobStore

This starts implementation of BlobStore which will replace all the
various storage layers we use for userpics/media. The idea is that we
should have one simple storage system and offload the work to other
people instead of doing it all ourself.

This is first part in removing MogileFS. It's a really complicated
system that is better replaced by using something simple with frontend
caching and/or a file storage service other people provide.

(Although the BlobStore interface was made with the idea that it can
support MogileFS pretty easily, so it's not actually hard... if we added
'namespace' to the API then it'd be a drop-in replacement.)

Additionally this adds Log::Log4perl as an easy way of logging things in
a more uniform way. I'm tired of not having logging messages and this
adds a very basic method of logging (with Carp support) in such a way
that it shows up in the Apache logs, but in a very useful format that
includes the package/line number that is generating the logs.


Commit: 5d780ef420aac9dd3955bc886476c31276166cd7
https://github.com/dreamwidth/dw-free/commit/5d780ef420aac9dd3955bc886476c31276166cd7
Author: Jen <kareila@dreamwidth.org>
Date: 2017-02-08 (Wed, 08 Feb 2017)

Changed paths:
M bin/checkconfig.pl
M bin/delete-bogus-media.pl
M bin/incoming-mail-inject.pl
M bin/maint/clean_caches.pl
R bin/upgrading/migrate-userpics.pl
M bin/upgrading/update-db-general.pl
M bin/upgrading/update-db.pl
M bin/worker/incoming-email
R bin/worker/userpic-resize-gm
M cgi-bin/Apache/LiveJournal.pm
A cgi-bin/DW/BlobStore.pm
A cgi-bin/DW/BlobStore/LocalDisk.pm
A cgi-bin/DW/BlobStore/MogileFS.pm
A cgi-bin/DW/BlobStore/S3.pm
M cgi-bin/DW/Controller/API/Media.pm
A cgi-bin/DW/Controller/EditIcons.pm
M cgi-bin/DW/Controller/Media.pm
M cgi-bin/DW/Controller/RPC/MiscLegacy.pm
M cgi-bin/DW/EmailPost/Entry.pm
M cgi-bin/DW/Media.pm
M cgi-bin/DW/Media/Base.pm
M cgi-bin/DW/Media/Photo.pm
M cgi-bin/DW/VirtualGift.pm
M cgi-bin/DW/Worker/ContentImporter/LiveJournal/Userpics.pm
M cgi-bin/DW/Worker/ContentImporter/UserPictures.pm
M cgi-bin/LJ/ConfCheck/General.pm
M cgi-bin/LJ/Config.pm
M cgi-bin/LJ/Directory/Constraint.pm
M cgi-bin/LJ/Directory/SetHandle/Mogile.pm
R cgi-bin/LJ/IncomingEmailHandle.pm
M cgi-bin/LJ/User/Account.pm
M cgi-bin/LJ/User/Icons.pm
M cgi-bin/LJ/Userpic.pm
M cgi-bin/ljlib.pl
M cgi-bin/modperl_subs.pl
M etc/config-private.pl
M etc/config.pl
A etc/log4perl.conf
M etc/workers.conf
M htdocs/admin/vgifts/index.bml
M htdocs/editicons.bml
M htdocs/tools/userpicfactory.bml
M t/aliases.t
A t/blobstore.t
M t/directorysearch.t
M t/media-security.t

Log Message:
-----------
Merge pull request #1829 from zorkian/start-blobstore

Start BlobStore


Compare: https://github.com/dreamwidth/dw-free/compare/5ef9d6b80867...5d780ef420aa