0.46.0.0

What's Changed

• Made "Projects" feature available to all Pro users (@gbp)
• Added batch and project stats to /version.json endpoint (@garethrees)
• Add logging of storage keys when destroying and redelivering incoming messages (@gbp)
• Remove PDF to HTML parsing and instead use modern browsers inline PDF viewer (@gbp)
• Added project administration UI (@gbp)
• Project submission contribution editing (@gbp)
• Add icons to classification forms (@garethrees, @lucascumsille)
• Store user locale preference in a separate cookie instead of the encrypted Rails session cookie to enable Varnish and other caching layers to read it (@dracos, @gbp)
• Simplify IncomingMessage/RawEmail admin actions so that only relevant actions are shown in various admin UI screens (@garethrees)
• Confirm unconfirmed users after following a password reset confirmation link (@garethrees)
• Don't redirect missing HTML conversion attachments to the request page (@dracos, @garethrees)
• Add rate limiting to request creation (@garethrees)
• Ability to exclude certain domains from creating responses via the web UI (@garethrees)
• Don't run the spam checker for admin accounts or accounts confirmed as not spam on sign in (@garethrees)
• Add no crawl meta tags to banned/closed user profile pages (@gbp)
• Add UserSpamScorer.spam_email_formats to test email addresses against regular expressions to see if they are spammy or not (@gbp)
• Add last_sign_in_at column to users (@gbp)
• Render Alaveteli configuration values on admin debug page (@garethrees)
• Clarify no sign ins message (@garethrees)
• Check user spam scoring on email address change (@gbp)
• Make requests sortable in the admin interface (@garethrees)
• Add classification icons to request lists in admin (@garethrees)
• Switch to sending user email change confirmation emails to the old email address for increased security verification (@gbp)
• Allow users to be tagged (@gbp)
• Update RESTRICTED_COUNTRIES configuration option to allow countries to be marked as permitted countries. With BLOCK_RESTRICTED_COUNTRY_IPS this will restrict sign ups and new requests to IP addresses from permitted countries (@gbp)
• Add ability to set individual features to read-only (@gbp)
• Add tracking of user profile email address changes (@gbp)
• Update outgoing mail failure handling (@gbp)
• Track user agents strings associated with User sign ins if configured (@gbp)
• Add ability to define custom spam scoring (@gbp)
• Improvements to project setup and editing workflow (@gbp)
• Add admin ability to edit outgoing messages without storing old body content (@gbp)
• Add experimental request insights feature (@gbp)
• Add user-to-user messaging configuration (@gbp)
• Add rel=nofollow attributes to links in outgoing messages (@gbp)
• Add task to purge profile content for limited user profiles after six months (@gbp)
• Add task to destroy users deemed unused after two years (@gbp)
• Limit user profile visibility until user accounts are confirmed active, reducing exposure of spam accounts (@gbp)
• Add User#status_update_count counter column (@gbp)
• Update admin text column rendering (@gbp)
• Improve visual accessibility and UX (@lucascumsille)
• Improve /browse page and individual category page UX (@zarino)
• Add public annotations configuration (@gbp)
• Add attachment locking and replacement (@gbp)
• Only send clarification notifications to recent requests (@garethrees)
• Improve citation form field width (@garethrees)
• Add report link to user profile pages (@garethrees)
• Only list users who have made requests in search results (@garethrees, @gbp)
• Collect cancellation reasons when Pro users cancel their subscriptions (@gbp)
• Removed old_unclassified_updated email (@gbp)
• Add Pro upsell on the user rate limited page (@gbp)
• Update Stripe payment description after Pro payments (@gbp)
• Add additional InfoRequest embargo scopes (@gbp)

Full Changelog: 0.45.3.2...0.46.0.0

0.45.3.0

Highlighted Features

• Upgrade to Rails 8.0 (Graeme Porteous)
• Add support for Ruby 3.4 (Graeme Porteous)

0.45.2.0

Highlighted Features

• Upgrade to Rails 7.2 (Graeme Porteous)
• Add support for Ruby 3.3 (Graeme Porteous)

0.45.1.0

Highlighted Features

• Upgrade to Rails 7.1 (Graeme Porteous)
• Update Rails application framework defaults (Graeme Porteous)
• Drop support for Ruby 3.1 (Graeme Porteous)

0.45.0.0

Highlighted Features

• Localise alert email subjects in the receiver's language (Anders Lindeberg)
• Remove deprecated Google Chart from request game (Gareth Rees)
• Migrated from Stripe Plans to Stripe Prices (Graeme Porteous)
• Change notes so that records tagged with name:value will be associated with notes tagged as name (Graeme Porteous)
• Upgrade Stripe API version (Graeme Porteous)
• Drop support for Azure storage (Graeme Porteous)
• Add basic Citation searching in admin UI (Gareth Rees)
• Improve citations admin to allow title and description updates (Graeme Porteous)
• Add public citations view (Graeme Porteous)
• Add project dataset question "select" format (Graeme Porteous)
• Fix script/mailin when multiple EXCEPTION_NOTIFICATIONS_TO addresses are specified (Graeme Porteous)
• Add example logrotate configuration (Graeme Porteous)
• Switch application server from Thin to Puma (Graeme Porteous)
• Fix rendering invoices page when there are discounted Pro subscription (Graeme Porteous)
• Drop support for Ruby 3.0 (Graeme Porteous)
• Allow projects owners to publish datasets (Graeme Porteous)
• Add comment deletion (Helen Cross, Graeme Porteous, Gareth Rees)
• Show and allow creation of citations from info request batch pages (Graeme Porteous)
• Allow pro users to create and manage Projects (Graeme Porteous)
• Improve Xapian queue health check (Graeme Porteous)
• Improve nginx configuration file for Sidekiq Web UI (Graeme Porteous)
• View user profile photos from admin list of users (Gareth Rees)
• Update user email to be sent from the blackhole address (Graeme Porteous)
• Remove ability to publicly view authority contact email addresses to prevent harvesting (Gareth Rees)
• Fix issues loading tags containing . or / in admin UI (Graeme Porteous)
• Change docker scripts to not require bash (Anders Lindeberg)
• Prevent multiple require admin emails from being sent (Graeme Porteous)
• Allow requests to be browsed by category (Graeme Porteous)
• Add default value and not null constraint to CensorRule#regexp (Gareth Rees)
• Allow requests to be listed and filtered by tag (Graeme Porteous)
• Fix admin error when authority are missing an email address (Graeme Porteous)
• Allow categories to have notes associated with them (Graeme Porteous)
• Add styling option and rich text editor to the notes admin (Graeme Porteous)
• Strengthen 2FA warning. Users must remember to keep this code safe (Gareth Rees)
• Broaden citation type classifications to cover wider thematic areas and add "campaigning" type (Gareth Rees, Graeme Porteous)
• Treat unstemmed words as normal search terms. (Matthew Somerville)
• Update /alaveteli_pro base path to /pro (Alexander Griffen, Graeme Porteous)
• Change use of /alaveteli_pro/info_requests/{request} to instead appear as /request/{request} (Alexander Griffen, Graeme Porteous)
• Remove locale prefixes from URLs (Alexander Griffen, Graeme Porteous)
• Update Twitter/X logos and wording (Lucas Cumsille Montesinos)
• Fix missing headers when exporting Project data (Gareth Rees)
• Reduce amount of storage related background jobs (Graeme Porteous)
• Add automatic parsing of emails contain Excel spreadsheets (Graeme Porteous)
• Improve rendering of admin hidden request prominence and explanations (Graeme Porteous)
• Add admin list of all citations (Gareth Rees)
• Improve redirection flow after user account closure actions (Gareth Rees)
• Fix duplicated attachment masking jobs (Graeme Porteous)
• Display metadata on admin attachment views (Graeme Porteous)
• Change request URL patterns to be member routes (Alexander Griffen, Graeme Porteous)
• Change request URL patterns to only use titles rather than request IDs (Alexander Griffen, Graeme Porteous)
• Colourise holding pen guess scores (Gareth Rees)
• Fix default holding pen guess scores (Gareth Rees)
• Add support for Debian 12 "Bookworm" (Graeme Porteous)
• Add support for Ubuntu 22.04 LTS "Jammy Jellyfish" (Graeme Porteous)
• Update alert daemon from init script to systemd (Sam Pearson)
• Update incoming mail poller daemon from init script to systemd (Sam Pearson)
• Update notification daemon from init script to systemd (Sam Pearson)
• Add basic admin notes index page (Gareth Rees)
• Restore delivery status notification attachment note (Gareth Rees)
• Explore CSV files in a Datasette Lite instance (Gareth Rees)
• Add link from incoming message to admin page for attachments (Gareth Rees)
• Add XLS & XLSX spreadsheet analyser to automatically detect hidden data (Helen Cross, Graeme Porteous)
• Update attachment processing to automatically rebuild if cached file goes missing (Graeme Porteous)
• Allow InfoRequest to be categorised (Graeme Porteous)
• Replace public body categories with generalised categories (Graeme Porteous)
• Add admin links to and from batch request show action (Graeme Porteous)
• Update request base calculated status for internal reviews (Graeme Porteous)
• Automatically apply not_many_requests tag to bodies who don't have many public requests so that they can be found in a public list or have tag-based notes applied (Gareth Rees)
• Improve background job performance by limiting the number NotifyCacheJob jobs created (Graeme Porteous)
• Signpost key user administration contributions for requests on request list pages (Gareth Rees)
• Signpost users to find new contact details for requests with delivery errors (Gareth Rees)
• Add admin view of unmasked version of main body part attachments (Gareth Rees)
• Add internal ID number to authority CSV download (Alex Parsons, Graeme Porteous)
• Don't show users that have closed their account or been banned on leaderboards (Chris Mytton)

0.44.0.0

Highlighted Features

• Improve handling of messages with multiple email addresses (Alexander Griffen)
• Fix admin timeline filters (Helen Cross, Graeme Porteous)
• Update Docker environment scripts (Graeme Porteous)
• Allow authority disclosure log URLs to be translated (Graeme Porteous)
• Remove Vagrant development boxes (Graeme Porteous)
• Improve calculation of authority home pages (Gareth Rees)
• Apply attachment censor rules and masks in the background (Graeme Porteous)
• Remove "inline" background job processing (Graeme Porteous)
• Add Xapian background job queue (Graeme Porteous)
• Single request guess delivery (Alexander Griffen, Graeme Porteous)
• Detect request email addresses in BCC/Received by headers (Alexander Griffen)
• Add disclosure log to authority JSON (Graeme Porteous)
• Add notify varnish cache job (Matthew Somerville, Graeme Porteous)
• Improve user comment anonymisation (Graeme Porteous)
• Show admin users previous names and slugs (Graeme Porteous)
• Add ability for users to change their name (Graeme Porteous)
• Separate admin account closure actions (Alexander Griffen, Gareth Rees)
• Make user content limit configurable (Gareth Rees)
• Add CSV files to Google Doc Viewer and refactoring (Gareth Rees)
• Show authority notes in admin (Helen Cross)
• Fix IP address matching in user spam scorer (Graeme Porteous)
• Fix logging duplicate events (Matthew Somerville)
• Fix favicon web server configuration (Graeme Porteous)
• Fix asset compilation issues (Graeme Porteous)
• Fix POP poller timeouts (Graeme Porteous)
• Code linting updates and refactoring (Alexander Griffen)
• Dependencies upgrades (Graeme Porteous)

Highlighted Pro Features

• View and download subscription invoices (Graeme Porteous)
• Add subscription started webhook state (Graeme Porteous)
• Update Stripe token information (Graeme Porteous)
• Improve batch request sending memory limit (Laurent Savaete)
• Fix draft batch request composition bug (Graeme Porteous)

Full Changelog: 0.43.2.0...0.44.0.0

0.43.0.0

Highlighted Features

• Improve censor rules comment editing (Alexander Griffen)
• Reduce the visual prominence of defunct bodies in lists (Gareth Rees)
• Improve application health metrics (Graeme Porteous)
• Add ability to display blog posts on request/authority page sidebars using tags (Graeme Porteous)
• Adding localisation to resent notice (Miroslav Schlossberg, Graeme Porteous)
• Add ability to paginate through requests in a batch (Gareth Rees)
• Add list of batch requests to admin user page (Gareth Rees)
• Add daily limit to user message creation (Gareth Rees)
• Add project leaderboards (Alexander Griffen)
• Add background job processing (Graeme Porteous)
• Add rate limiting to comment creation (Gareth Rees)
• Fix bug preventing ex-pro users follow up to still-private requests (Gareth Rees, Graeme Porteous)
• Make it clearer that usernames are published (Gareth Rees)
• Add spam term checking to user to user messages (Gareth Rees)
• Install script improvements (Graeme Porteous)
• Update passenger config (Graeme Porteous)
• Removed legacy event params (Graeme Porteous)
• Removed legacy notes (Graeme Porteous)
• Fix rendering of notes on request new (Graeme Porteous)
• Add support for Ruby 3.2 (Graeme Porteous)
• Add support for Ruby 3.1 (Graeme Porteous)
• Upgrade to Rails 7 (Graeme Porteous)
• Improve processing of large PDF attachments (Graeme Porteous)
• Add support for Ruby 3.0 (Graeme Porteous)
• Drop support for Ruby 2.7 (Graeme Porteous)
• Code linting (Alexander Griffen, Graeme Porteous)
• Dependencies upgrades (Alexander Griffen, Graeme Porteous)

Full Changelog: 0.42.0.1...0.43.0.0

0.42.0.0

Highlighted Features

• Use CSV output and ignore case for users:count_per_domain stats (Gareth Rees)
• Improve storage of event parameter data (Graeme Porteous)
• Allow admins to destroy post redirects (Gareth Rees)
• Add initial administration UI for batch requests (Gareth Rees)
• Add ability to hide individual attachments using prominence (Graeme Porteous)
• Refactor requests, outgoing messages, incoming messages and attachments prominence to be consistent and reusable (Graeme Porteous)
• Fix categorisation game total requests count (Gareth Rees)
• Add count of requests in each prominence state to body and user admin pages (Gareth Rees)
• Update all-authorities.csv endpoint to download and cache file nightly (Graeme Porteous)
• Improved notes feature, allowing multiple notes to be associated with bodies and requests. Association can either be direct or via a tag. Tagged notes are useful for displaying one note to a subset of bodies or requests which are all tagged with the same tag (Gareth Rees, Graeme Porteous, Lucas Cumsille Montesinos)
• Add administration UI for notes (Graeme Porteous)
• Add administration UI for tags (Graeme Porteous)
• Allow outgoing messages, incoming messages to be tagged (Graeme Porteous)
• Automatically apply missing_email tag to bodies who are missing a request email so that they can be found in a public list (Gareth Rees)
• Improve linking from outgoing & incoming message admin pages (Gareth Rees)
• Allow admins to destroy user post redirects (Gareth Rees)
• Use correct mime type for cached CSV attachments (Gareth Rees)
• Improvements to the admin object columns listings (Gareth Rees, Graeme Porteous)
• Protect mass-tag update buttons in admin bodies lists (Gareth Rees)
• Dependencies upgrades (Alexander Griffen, Graeme Porteous)

Highlighted Pro Features

• Allow former pro to classify embargo requests (Graeme Porteous)

0.41.1.0

Highlighted Features

• Add simple classification game milestone celebration (Gareth Rees)
• Remove legacy batch request interface (Graeme Porteous)
• Dependencies upgrades (Graeme Porteous)

Highlighted Pro Features

• Enable the batch category picker for all new Pro users (Graeme Porteous)

Full Changelog: 0.41.0.0...0.41.1.0

0.41.0.0

Highlighted Features

• Improve admin authorisation for embargoed content (Laurent Savaete, Graeme Porteous)
• Fixes some colour contrast accessibility issues (Lucas Cumsille Montesinos)
• Clarify foi_no special tag usage in admin UI (Gareth Rees)
• Make law used clearer on authority page (Gareth Rees)
• Add mass "delete tag" button for authorities in admin UI (Graeme Porteous)
• Add drag and drop handles to admin category interface (Gareth Rees)
• Improve spam notification messages with IP and country (Gareth Rees, Graeme Porteous)
• Remove Gaze support (Graeme Porteous)
• GitHub Action permission (Naveen Srinivasan, Graeme Porteous)
• Add clarification request button to incoming message admin actions (Gareth Rees)
• Show day of week in admin timeline (Gareth Rees)
• Improve admin CSV upload error prominence (Gareth Rees)
• Show all applicable censor rules on admin request pages (Gareth Rees)
• Track IP addresses associated with User sign ins if configured (Gareth Rees)
• Improve authorities questions radio button styling (Lucas Cumsille Montesinos)
• Add Xapian Job count health check (Graeme Porteous)
• Add "revert log in as" feature for admins (Graeme Porteous)
• Add admin user scopes tabs (Gareth Rees, Graeme Porteous)
• Show citations on admin pages (Gareth Rees)
• Show public body change request notes on body edit page (Gareth Rees)
• Show public body change request notes in the admin summary (Gareth Rees)
• Link to Public Body Change Request source URLs in admin interface (Gareth Rees)
• Admin styles for page printing or saving as PDF (Lucas Cumsille Montesinos)
• Add support ActiveStorage for attachments (Graeme Porteous)
• Block sign ups from restricted countries (Gareth Rees)
• Improve comment metadata on comment edit page (Gareth Rees)
• Improve comment metadata on comment listings (Gareth Rees)
• Add extra common one-click user ban reasons (Gareth Rees)
• Improve admin page browser tab titles (Gareth Rees)
• Show who made each edit on public body admin pages (Gareth Rees)
• Cap number of annotations a user can make in a day (Gareth Rees)
• Add "select all" button for annotations on admin pages (Gareth Rees)
• Fix rendering of refusal advice overflow (Lucas Cumsille Montesinos)
• Add support ActiveStorage for raw emails (Graeme Porteous)
• Add canned censor rule replacement reasons (Gareth Rees)
• Localise stripping of salutations (Gareth Rees)
• Ensure comments are reindexed after a bulk visibility change (Gareth Rees)
• Reduce attractiveness of Alaveteli to spammers by only showing user "about me" profile text to logged in users, or when the user has been manually marked as genuine (Gareth Rees)
• Add /tor path for redirecting sign ups from Tor at the webserver level (Gareth Rees)
• Add donate link to request page sidebar (Lucas Cumsille Montesinos, Gareth Rees)
• Upgrade to Rails 6.1 (Graeme Porteous)
• Preparation for Rails 7.0 upgrade (Graeme Porteous)
• Drop support for Ruby 2.5 (Graeme Porteous)
• Drop support for Ruby 2.6 (Graeme Porteous)
• Drop support for Debian 9 Stretch (Graeme Porteous)
• Drop support for Debian 10 Buster (Graeme Porteous)
• Drop support for Ubuntu 18.04 Bionic (Graeme Porteous)
• Continued code refactoring and improvements (Gareth Rees, Graeme Porteous)
• Dependencies upgrades (Graeme Porteous)

Highlighted Pro Features

• Add batch authority count (Graeme Porteous)
• Improve batch duplication detection (Graeme Porteous)
• Add batch category UI improvements (Graeme Porteous)
• Add batch category performance improvements (Graeme Porteous)
• Add feature groups to grant access to multiple features based on user roles (Graeme Porteous)

Full Changelog: 0.40.1.2...0.41.0.0