AO3 News

Releases 0.9.27 - 0.9.28: Change Log

Published: 2014-10-10 18:49:41 -0400

Credits

  • Coders: james_, sarken
  • Code reviewers: Ariana, Enigel, james_, Scott
  • Testers: Lady Oscar, mumble, Runt

Details

  • Challenge sign-up forms used checkboxes instead of autocomplete unless there were more than 500 tag options for a given field (e.g. fandom). That many checkboxes was not user-friendly. Now it will switch to autocomplete when there are more than 20 tags.
  • Fixed a broken link on our site map.
  • Removed parts of the AO3 admin interface which were no longer required.
  • Fixed a bug that would prevent admins from accessing comments left on restricted (locked to AO3 users) works.
  • In the most recent version of Safari (7.1), the comment field would jump around when clicking into and out of it. This has been fixed!
  • In preparation for our Membership Drive, we added a new feature to the site-wide banners used for such occasions.

Known Issues

See our Known Issues page for current issues.

Comment

Release 0.9.26: Change Log

Published: 2014-10-06 17:35:19 -0400

Credits

  • Coders: Emily E, james_, Lady Oscar
  • Code reviewers: Ariana, Elz, james_
  • Testers: Lady Oscar, mumble, Scott

Details

  • The Locales page now lists all locales that the Archive supports. (What's a locale?) Users can now suggest new locales, and Admins can edit or add existing locales from this page.
  • Previously when following incorrect links to AO3 News posts, pseuds, works, or tags, the Archive would redirect you to the next best page, e.g. the main works index, and display a brief message. Instead of redirecting, we now show an Error 404 page. This preserves the address (work, tag, etc.) you were trying to reach in the address bar, allowing you to fix a typo and try again, for example.
  • If for some reason your browser cookies for the AO3 get deleted or corrupted, you will be automatically logged out of the Archive and shown a page informing you of the action. (See our post, https://archiveofourown.org/admin_posts/1277, for tips and tricks on dealing with log-in problems.)
  • We fixed and updated a number of our automated tests (which ensure that the Archive will still work as expected when we change or update code).
  • We also added and improved automated tests that cover administrative actions (such as posting a new AO3 News post, or managing invitations), moving us closer to 100% code coverage of those features!
  • The Technical Support and Feedback form has been updated to correctly list all the languages Support can answer questions in. The new ones are: català, čeština, magyar, and Русский.
  • We have updated a section of the Archive TOS FAQs. The final sentence of the "Can I archive original fiction" question has been changed to: "We presume that, by posting the work to the Archive, the creator is making a statement that they believe it's a fanwork. As such, unless the work doesn't meet some other criterion, it will be allowed to remain.". Previously, the final sentence read: "In general, when there is doubt as to whether a particular work counts as a fanwork, we will trust the judgment of the work's creator."

Known Issues

See our Known Issues page for current issues.

Comment

Release 0.9.24: New FAQ code!

Published: 2014-09-29 17:06:34 -0400

Credits

  • Coders: Elz, james_, Sarken, Scott
  • Code reviewers: Elz, Enigel, James
  • Testers: Camilla M, helebr, Lady Oscar, Mei, mumble, Priscilla, Ridicully

Extra special thanks to Scott for helming this project through sunshine and rain! ♥

Details

This code update includes many improvements to the Archive FAQ, our help section for new and experienced users alike. This part of the site grows and changes with the Archive, and will see even more improvements in future updates. For now, we offer these new features for your enjoyment:

  • You can now browse our FAQs in languages other than English! Since both the FAQs and their translations are a work in progress, only a few categories have translations right now. We'll be adding more during the coming months, and will update outdated information across all sections.
  • As soon as at least one FAQ category (e.g. Pseuds, Bookmarks, Comments, etc.) is available in a language, that language will show up in the dropdown menu at the top right of the main FAQ index. Only translated categories will be listed, so if you can't find the information you're looking for, please refer back to the English index. (Work in progress!)
  • There are now buttons on the main index to show all available questions ("Expand Categories") and to hide them all again ("Collapse Categories"), so you can skim the page or search for exactly the information you're interested in.
  • At the top of each category, you'll find a list of available questions, so you can quickly jump to just the answer you need.
  • The system now allows for direct links to each question/answer pair on a page (e.g. How do I subscribe to a work?), which wasn't fully supported before.
  • The new FAQs have "pretty" URLs, which means they don't just contain the id of the FAQ category (as in, /archive_faqs/17), but rather the title of the page (as in, /faq/orphaning).
  • Contrary to expectations in our original announcement, there will be no broken links. Old links (e.g. archiveofourown.org/archive_faqs/7) will automatically redirect to the new pages (e.g. Pseuds).
  • Our public wrangling guidelines, which were previously (and somewhat awkwardly) part of the FAQ section, have gotten their own home! You can consult these pages when in doubt about how to best format a new tag, or if you're wondering about specific wrangling concepts and policies.

Extra Credits

Our AO3 Documentation volunteers are working very hard to update the old, sometimes very outdated FAQs, and our many translators are working on translating them: either the new and improved documentation or, in some cases (when we have the volunteer power), some old documentation that might still be helpful, while waiting for it to be updated.

  • Documentation writers: AnneVictoire, C-chan, DekuDani, ltfoxyee, MadameHardy, Sammie, trickybonmot and 12 AO3 Documentation volunteers
  • Translators: Agnieszka Górniok, Amalia Blondet, ambersnake, Ana Carolina Nonato, Ana Solis, Aneta Sikora, Ania Kopertowska, Anne-Katrin Koch, Arithanas, Artmetica, balistener, birggitt, Blacktablet, Charlotte, ChristyCorr, Daniela Kreimerman, DeeCharlotte, Eilean, Eimry, Ely_Baby, Elysandra, Fatma Bahr, fluffygreenpillow, Gloria Monika (Rizu), Hayyu A (Alinka), headinthecloudsgirl, Jocelin Potash, John (rcmero), Karagodina Elena, Kaysa (Sarah K.), Konomon Freezlight, LilyC, Liselot, Luisa, M.Rios, Meep, MrBalkanophile, Nana, Nerine Luna, regenorakel, Ridicully, rocksound, soniclipstick (veriscence), SunnyB, Tatanka, tamat9, White Hawk, Yenelie, and 76 translators

Known Issues

When you pick a language from the dropdown menu to access available FAQs in your language, for example Spanish, the language information will be included in the URL, like faq/about?language_id=es. When you leave the FAQ section, e.g. by selecting the All Fandoms link in the header menu, this language information will follow you to that page. Since so far only the FAQ section is translated, however, there will be no other effect. When you continue browsing, the next page you visit will have the normal URL again.

See our Known Issues page for other current issues.

Comment

September Release Notes: Invisible Code!

Published: 2014-09-28 19:31:13 -0400

We deployed several chunks of code this month that didn't get their own posts (mostly because we went right back to working on more code once we were done with those chunks /o\). It's been a busy month, and we have a lot of exciting stuff coming up. For now, have a brief summary of the stuff you didn't see.

New admin banners!

Credits

  • Coder: Sarken
  • Code reviewer: james_
  • Testers: Lady Oscar, mumble

Details

This update went live on September 12; however, we haven't used our banner messages since then, so it's been a very invisible change. If we need to inform you about current site issues again, the blue boxes at the top of each page will be much easier to update and much prettier to look at from now on. Also, we have a little surprise planned for our upcoming Membership Drive, so watch this space!

New indexing code!

Credits

  • Coder: Elz
  • Code reviewers: Enigel, james_

Details

On September 18, we deployed the first part of our Big Search & Browse Upgrade of 2014, which we described in a little more detail in our Notes on Release 0.9.20 (look for the "Next Step" section). To prepare for the general overhaul, we added code to the site that takes all the data in our database and builds a new, improved, and stable index in Elasticsearch 1.3 (upgraded from 0.90). This is happening in the background, on a fresh install of Elasticsearch separate from our current setup. Special thanks to our Systems wizard james_ for all his hard work in this process!

The new search index will find its match in new and improved code for filtering works and bookmarks, to go live next month. The basic functionality will be mostly unchanged, but you can expect some improvements to your filtering experience and more reliable work and bookmark listings. \o/

Comment

Release 0.9.20: Improvements to our search index code!

Published: 2014-09-09 16:43:05 -0400

Credits

  • Coder: Elz
  • Code reviewers: Enigel, james_
  • Testers: Ariana, Lady Oscar, mumble, Ridicully, sarken

Overview

With today's deploy we're making some changes to our search index code, which we hope will solve some ongoing problems with suddenly "missing" works or bookmarks and inaccurate work counts.

In order to improve consistency and reduce the load on our search engine, we'll be sending updates to it on a more controlled schedule. The trade-off is that it may take a couple of minutes for new works, chapters, and bookmarks to appear on listing pages (e.g. for a fandom tag or in a collection), but those pages will ultimately be more consistent and our systems should function more reliably.

You can read on for technical details!

The Problem

We use a software package called Elasticsearch for most of our search and filtering needs. It's a powerful system for organizing and presenting all the information in our database and allows for all sorts of custom searches and tag combinations. To keep our search results up to date for everyone using the Archive, we need to ensure that freshly-posted works, new comments and kudos, edited bookmarks, new tags, etc. all make it into our search index practically in real time.

As the volume of updates has grown considerably over the last couple of years, however, that's increased the time it takes to process those updates and slowed down the general functioning of the underlying system. That slowness has interacted badly with the way we cache data in our current code: works and bookmarks seem to occasionally appear and disappear from site listings and the counts you see on different pages and sidebars may be significantly different from one another.

That's understandably alarming to anyone who encounters it, and fixing it has been our top priority.

The First Step

We are making some major changes to our various "re-indexing" processes, which take every relevant change that happens to works/bookmarks/tags and update our massive search index accordingly:

  • Instead of going directly into Elasticsearch, all indexing tasks will now be added to a queue that can be processed in a more orderly fashion. (We were queueing some updates before, but not all of them.)
  • The queued updates will then be sent to the search engine in batches to reduce the number of requests, which should help with performance.
  • Cached pages get expired (i.e., updated to reflect new data) not when the database says so, but when Elasticsearch is ready.
  • Updates concerning hit counts, kudos, comments, and bookmarks on a work (i.e. "stats" data) will be processed more efficiently but less frequently.

As a result, work updates will take a minute to affect search results and work listings, and background changes to tags (e.g. two tags being linked together) will take a few minutes longer to be reflected in listings. Stats data (hits, kudos, etc.) will be added to the search index only once an hour. The upside of this is that listings should be more consistent across the site!

(Please note that this affects only searching, sorting, and filtering! The kudos count in a work blurb, for example, is based on the database total, so you may notice slight inconsistencies between those numbers and the order you see when sorting by kudos.)

The Next Step

We're hoping that these changes will help to solve the immediate problems that we're facing, but we're also continuing to work on long-term plans and improvements. We're currently preparing to upgrade our Elasticsearch cluster from version 0.90 to 1.3 (which has better performance and backup tools), switch our code to a better client, and make some changes to the way we index data to continue to make the system more efficient.

One big improvement will be in the way we index bookmarks. When we set up our current system, we had a much smaller number of bookmarks relative to other content on the site. The old Elasticsearch client we were using also had some limitations on its functionality, so we ended up indexing the data for bookmarked works together with each of their individual bookmarks, which meant that updates to the work meant updates to dozens or hundreds of bookmark records. That's been a serious problem when changes are made to tags, in particular, where a small change can potentially kick off a large cascade of re-indexes. It's also made it more difficult to keep up with regular changes to works, which led to problems with bookmark sorting by date. We're reorganizing that, using Elasticsearch's parent-child index structure, and we hope that this will also have positive long-term effects on performance.

Overall, we're continuing to learn and look for better solutions as the Archive grows. We apologize for the bumpy ride lately, and we hope that the latest set of changes will make things run more smoothly. We should have more improvements for you in the coming months, and in the meantime, we thank you for your patience!

Comment

Release 0.9.18: Change Log

Published: 2014-08-28 17:09:45 -0400

Credits

  • Coders: Ariana, hill, james_, Marie, sarken, Scott, Stephanie Smith
  • Code reviewers: Ariana, Elz, james_
  • Testers: Lady Oscar, mumble, sarken

Details

  • The experimental "Hide my work from search engines when possible." preference was not properly applying the necessary markers to individual works. Now it does.
  • When a user tried to access a page that didn't exist, we previously displayed an error message and redirected the user to a more general page. We now properly show the 404 error page with a helpful hint about what content couldn't be found.
  • When trying to remove the name from a collection, you'd get an ugly error 500; now a proper error message is displayed that asks you to enter a name.
  • Rewrote the live validation code used for various error messages across the site, e.g. if you click into and then out of a comment field without typing anything, to make it more maintainable. (This was deployed as Release 0.9.17.)
  • Optimized the code we use to make sure usernames and passwords have the proper length when creating a new account or changing the password.
  • The label and input on the bookmark filters are now properly associated in the HTML, which is important for accessibility.
  • Fixed some mark-up in our header and footer code in preparation for more work on site translation.
  • Some mark-up on the "New Tag" page (accessible to wranglers) was wonky; now it's not wonky anymore.
  • Fixed various broken bits in our automated testing suite.

Known Issues

We are currently dealing with indexing and caching issues which mean works might suddenly go "missing" from a tag listing, or a user's own works page. The work is still in the database, but the search index is intermittently losing track of it. Please bear with us as we work to solve these problems!

See our Known Issues page for current issues.

Comment

Release 0.9.16: Change Log

Published: 2014-08-12 17:17:41 -0400

Welcome to Release 0.9.16, in which we declare our frantic multi-part releases over, and go back to frantic one-part deploys (which doesn't really make much of a difference except for our Release Notes titles). In the past five months, we've fixed about 200 bugs and gone from eight pages of queued up code submissions down to one. \o/ With that done, we can now take the opportunity to look at our backlog of planned new features and enhancements and consider our strategy for the rest of the year. Onward!

Credits

  • Coders: james_, openendings, sarken, Scott, Stephanie Smith
  • Code reviewers: Enigel, sarken
  • Testers: Ariana, Lady Oscar, Runt, sarken, Scott

Details

  • Works & Subscriptions
    • We changed some elements of the "Edit Chapter" form to make the button layout, formatting, and behavior more like that of the "Edit Work" form.
    • Changed the message at the end of the kudos listing for works with more than 50 kudos to say "and 1 more user" or "and X more users" depending on whether there are one or more hidden kudos. (Previously the message said "and X more user(s)" in both cases.)
    • Using the "Subscribe" button on a multi-chaptered work no longer redirects the user to the first chapter.
    • Previously, unsubscribing from a work redirected the user to the last page visited, even if it was opened in another tab. Now, unsubscribing should not redirect the user.
  • Users & Accounts
    • Changing only the capitalization of a user name left the user with the original capitalization as their default pseud. It should now work normally, with the user name set to the new capitalization and no extra pseud created.
    • Submitting the "Edit My Profile" form will now bring the user to the Profile page to see the changes, rather than just leaving the form open.
    • We made some changes to the settings our administrators use to control account creation on the Archive. The buttons on the Archive front page will change to match the chosen settings: currently, new accounts require an invite, so the front page asks you to add yourself to our invite queue if you are not logged in.
  • Collections & Challenges
    • Because collection names cannot contain spaces, long names were failing to wrap properly, instead running out of the blurb and overlapping with other components of the page. They are now forced to wrap to stay within the blurb.
    • It was previously possible to open signups for a challenge with anomalous dates. Now, trying to save challenge settings with sign-ups open and an opening date in the future, a closing date in the past, or a closing date before the opening date, will give an error message.
  • Misc.
    • The "live validation" error messages that appear under many Archive form fields when too many or too few characters are entered were causing the other elements of the form to move up or down in a distracting way as they appeared and disappeared. The messages now appear overlaid on the form in popup rectangles, with the rest of the form staying put.
    • As a side-effect of a form layout change in our last update, the "All" and "None" buttons on the pages Tag Wranglers use to edit a tag's associations were selecting tags outside the button's section. This has now been fixed.
    • We added a colored ribbon to our Staging and Development environments to make it easier for our Testers and Coders to keep them straight from the actual Archive.

Known Issues

See our Known Issues page for current issues.

Comment

Release 0.9.15 (Part 9): Change Log

Published: 2014-07-28 23:53:14 -0400

Credits

  • Coders: Ariana, Elz, Enigel, Sarken, Scott, Stephanie Smith
  • Code reviewers: Enigel, james_
  • Testers: Lady Oscar, mumble, Sarken

Details

  • Subscriptions
    • Users' subscription pages previously listed all subscriptions on a single page, regardless of subscription type. Now series, work, and user subscriptions can be listed separately, and the lists are sorted alphabetically and separated into pages of 20 items to improve performance for users with hundreds or thousands of subscriptions.
  • Tag Sets
    • When a user nominates tags for a tag set, we provide tooltips to let them know when they've nominated a tag that is brand new to the Archive or a tag that exists but is neither a canonical tag nor a synonym of one. Now we also provide tooltips so users will know when they have nominated a canonical tag, a synonym of a canonical tag, or a canonical character or relationship tag that doesn't match the fandom tag they've nominated.
    • The list of tags a user has nominated in a tag set received some minor cosmetic changes to make it neater and more consistent with other areas of the site.
    • When a challenge's tag set included a very long tag (e.g. "Stephen Colbert's Alpha Squad 7: Lady Nocturne: A Tek Jansen Adventure - Stephen Colbert"), Firefox users were unable to see the full name of the tag on the challenge sign-up form. Now they can scroll horizontally to see the full tag.
    • It is now possible to delete a tag set nomination, clear all nominations for a tag set, or delete the tag set itself without having JavaScript enabled.
  • Challenges
    • The error message warning that required information was missing from a gift exchange or prompt meme sign-up previously did not specify which request(s) or offer(s) were missing information. Now a message will also appear above the specific request or offer with the problem.
    • Previously, it was impossible for the moderator of a prompt meme to delete the last prompt of a user's sign-up. Moderators can now remove the entire sign-up, making it easier to keep bogus prompts out of a challenge.
  • Misc.
    • When a creator removed the only work in a series by editing the work and choosing the "Remove" button, they were redirected to the now nonexistent series page, resulting in an error. This has been fixed to redirect the creator to their dashboard.

Known Issues

See our Known Issues page for current issues.

Comment


Pages Navigation