Commit Graph
59 Commits
Author SHA1 Message Date
706ab8f5ab Improvements to phpBB3 import script (#10999)
* FEATURE: Import attachments

* FEATURE: Add support for importing multiple forums in one

* FEATURE: Add support for category and tag mapping

* FEATURE: Import groups

* FIX: Add spaces around images

* FEATURE: Custom mapping of user rank to trust levels

* FIX: Do not fail import if it cannot import polls

* FIX: Optimize existing records lookup

Co-authored-by: Gerhard Schlager <[email protected]>
Co-authored-by: Jarek Radosz <[email protected]>
2021-01-14 21:44:43 +02:00
Jarek RadoszandGitHub aaab9e46fc FIX: Import posts of missing users from phpbb3 (#9085)
Posts without a user probably shouldn't happen unless there was some direct database tampering, but data like that has been seen in the wild.

The importer will assign those posts to the "system" user.
2020-03-06 22:54:40 +01:00
Gerhard Schlager 4474693c69 Make import scripts work with frozen strings 2019-05-30 22:22:24 +02:00
Sam Saffron daff2c0921 FIX: ensure we can download maxmind without redis or db config
This also corrects FileHelper.download so it supports "follow_redirect"
correctly (it used to always follow 1 redirect) and adds a `validate_url`
param that will bypass all uri validation if set to false (default is true)
2019-05-28 10:28:57 +10:00
Sam SaffronandGuo Xiang Tan 5fbcc5cb35 DEV: enable frozen string literal on all files
This reduces chances of errors where consumers of strings mutate inputs
and reduces memory usage of the app.

Test suite passes now, but there may be some stuff left, so we will run
a few sites on a branch prior to merging
2019-05-13 09:31:32 +08:00
Gerhard Schlager 34e5a050e0 FIX: Importing of polls from phpBB3 was broken
Follow-up to f6a33fa7
2019-05-06 12:37:19 +02:00
Penar MusarajandGitHub 48e568ebb8 FEATURE: add more granular user option levels for email notifications (#7143)
Migrates email user options to a new data structure, where `email_always`, `email_direct` and `email_private_messages` are replace by

* `email_messages_level`, with options: `always`, `only_when_away` and `never` (defaults to `always`)
* `email_level`, with options: `always`, `only_when_away` and `never` (defaults to `only_when_away`)
2019-03-15 10:55:11 -04:00
Gerhard Schlager f6a33fa7e5 Improve phpBB3 importer
* Log errors when mapping of posts, messages, etc. fails
* Allow permalink normalizations for old subfolder installation
* Disable importing of polls for now. It's broken.
2019-02-17 23:20:20 +01:00
David TaylorandGuo Xiang Tan e4e4b64c7e DEV: Enable Style/SingleLineMethods and Style/Semicolon in Rubocop (#6717) 2018-12-04 11:48:13 +08:00
Neil Lalonde c90225438f FIX: add support for string avatar_type values in PHPBB3 importer 2018-06-07 18:14:11 -04:00
Régis Hanol b32a21c5ff don't import data only available in a plugin in phpBB 3 importer 2018-03-17 00:36:12 +01:00
Régis Hanol 9aa202add0 Update PHPBB3 importer
- Extract name from profile_fields_data table
- Use 'posts.poster_ip' to track topic views
2018-03-16 18:32:27 +01:00
Régis Hanol 17ff4e5da5 import topic views in phpbb3 2018-03-07 19:27:03 +01:00
Gerhard Schlager 97c652b4ac FIX: BBCode to Markdown conversion in phpBB3 importer was broken
This fixes the conversion for quotes, code blocks and lists (except for nested lists). It also discourages the usage of the ruby-bbcode-to-md gem.
2018-01-30 12:50:42 +01:00
Gerhard Schlager 63dd90b28d FIX: phpBB3 importer imported some users as anonymous users 2018-01-30 12:50:42 +01:00
Neil Lalonde edbe4bdcf9 make rubocop happy 2017-11-07 14:20:46 -05:00
discoursehostingandRégis Hanol addae9ee48 some improvements for importers (#5295)
* decode html entities within code blocks

* Only import users that actually participated in the bbpress part of Wordpress; import password hashes

* create permalinks for topics

* Better handling of [code] blocks
2017-11-07 17:50:43 +01:00
Gerhard Schlager d6d3b7175e phpBB3 importer: Fix validation of site settings 2017-08-29 01:48:30 +02:00
Guo Xiang TanandGitHub 5269b652cd Add rubocop to our build. (#5004) 2017-07-28 10:20:09 +09:00
Gerhard Schlager 5ab16599cf phpBB3 importer: Permalink for first post of each topic was missing 2017-07-25 23:29:56 +02:00
Gerhard Schlager 1ee5c1ef83 phpBB3 importer: Use permalink normalization for category links 2017-07-25 21:14:46 +02:00
Robin Ward 61ceadfa3d Refactor FileHelper to use keyword arguments. 2017-05-24 13:54:26 -04:00
Robin Ward c0bef79179 We don't need to log downloading avatars that are too large 2017-05-09 14:46:42 -04:00
Gerhard Schlager 062c01828f phpBB3 importer: Disable file size validators during import 2017-04-26 01:05:36 +02:00
Gerhard Schlager 4308fc49ef phpBB3 importer: Fix the link regex
Thanks to Leo Davidson for the improved regex.
https://meta.discourse.org/t/importing-from-phpbb3/30810/153
2017-02-05 17:13:31 +01:00
Gerhard Schlager 5639b8377d phpBB3 importer: Fix import of anonymous users 2017-02-05 15:26:50 +01:00
Gerhard Schlager f32c29e203 phpBB3 importer: Make it harder to set wrong table prefix 2017-02-05 14:13:25 +01:00
Gerhard Schlager 2201468098 phpBB3 importer: Don't ignore users that belong to non-existent group 2017-02-05 14:13:25 +01:00
m.bandGitHub c7e680dff7 Add missing fat arrow in bbcode_to_md method rescue block
Related to https://meta.discourse.org/t/undefined-local-variable-or-method-e-during-phpbb3-migration/48861
2016-08-19 13:18:27 +02:00
Gerhard SchlagerandRégis Hanol b1a79cc5d3 phpBB3 importer: fixes for internal links and guest users (#4350)
* phpBB3 importer: ignore query parameters in internal links

* phpBB3 importer: Don't fail if guest usernames differ only by case

* phpBB3 importer: Import username as name for guest users
2016-07-27 22:57:33 +02:00
Gerhard SchlagerandRégis Hanol 343ca61724 Store the original username during import (#4349) 2016-07-27 22:30:15 +02:00
Gerhard SchlagerandRégis Hanol 83a892dbb6 A few small changes to the phpBB3 importer (#4321)
* Reconnect to phpBB3 database on connection loss

* Map geek smiley to :nerd: emoji in phpBB3 importer

* Import PMs to yourself from phpBB3

* Allow empty table prefix in phpBB3 importer
2016-07-11 23:59:15 +02:00
Gerhard SchlagerandRégis Hanol 7df68df708 Make phpBB3 importer compatible with latest poll plugin changes (#4253) 2016-06-06 22:59:33 +02:00
Gerhard Schlager b5bb5f927b Make sure PMs imported from phpBB3 are only visible to the correct users
In addition this tries to automatically fix PMs that were migrated
from phpBB2 to phpBB3.
2016-05-26 20:27:08 +02:00
Gerhard Schlager 77e358252f Fix import from phpBB 3.1 2016-05-07 23:35:48 +02:00
Régis Hanol 15035f8a4c Merge pull request #4191 from gschlager/phpbb3-importer-polls
Fix import of polls from phpBB3
2016-04-25 10:32:43 +02:00
Gerhard Schlager c78a4c79c9 Stop using OFFSET in DB queries of phpBB3 importer
http://use-the-index-luke.com/no-offset
2016-04-24 14:25:35 +02:00
Gerhard Schlager b26f76fe57 Fix import of polls from phpBB3 2016-04-23 23:03:50 +02:00
Gerhard Schlager fab9305a2a Make permalink import from phpBB3 configurable
There are a few changes to the original permalink import:
- adds permalinks for posts
- does not create incorrect permalinks for private messages
- adds permalink normalizations for topics and posts
2016-04-09 22:36:45 +02:00
Axel Naumann aff082a617 Make port number configurable. 2016-03-29 20:47:48 +02:00
Régis Hanol 710845be6f Merge pull request #4054 from ryantm/phpbb-import-script
phpbb-import-script: move bbcode_to_md to before other text processing
2016-03-07 18:17:12 +01:00
Robin Ward 58c720da9d FEATURE: Adds ~200 more emoji
This includes all new emoji from Unicode 7 and Unicode 8 with the
exception of skin tones which will require a new interface.
2016-03-04 15:10:14 -05:00
Ryan Mulligan 943505415b phpbb-import-script: move bbcode_to_md to before other text processing
This seems to fix the issue I reported at
https://meta.discourse.org/t/import-script-phpbb/40424
2016-03-02 15:14:58 -08:00
Guo Xiang Tan e159b41d64 Some fixes for phpbb importer. 2016-03-01 10:21:54 +08:00
Guo Xiang Tan 9fab7b4e92 Add Permalink to phpbb3 import script. 2016-02-29 11:48:43 +08:00
Gerhard Schlager ce03391026 Map :-) to :slightly_smiling: during phpBB3 import 2016-02-04 20:39:53 +01:00
Gerhard Schlager 7d212bea65 Prepare settings file for Docker based phpBB3 importer 2016-02-04 20:39:53 +01:00
Gerhard Schlager e45effe3c1 Better error handling for polls imported from phpBB3 2016-01-13 22:57:57 +01:00
Gerhard Schlager 32021da5b6 Failed file upload shouldn't crash phpBB3 importer 2016-01-13 22:56:45 +01:00
Gerhard Schlager 9ec869f390 FIX: Correctly import users and passwords from phpBB 3.1
- Ruby doesn't support the $2y$ prefix used for bcrypt Blowfish hashes.
- The importer ignored users that didn't have optional profile fields.
2015-12-26 23:05:19 +01:00