Gwyneth Llewelyn
|
add89f31f9
Configuration now is read from file (using the Viper library). Some changes need to be made to support other databases.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
16bd60461c
Added logging options to config file as well.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
373224b041
Because this is getting increasingly complicated, there is now a configuration file.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
01ac1dbb52
Attempt to use BuntDB instead of Badger
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
663c41bd0f
Reduce to batches of 100,000 keys
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
37808f31a7
Attempting to change all code to work with the new version of Badger (changed everything!)
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
01a083b88a
More (failed!) attempts to limit memory consumption by reducing the ValueLogFileSize
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
908ac9477e
While memory errors seem to be fixed, there is a strange error related to opening the correct directory under FastCGI.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
1a196640ff
Changing to use BatchSetAsync; attempting to deal with excessive memory issues.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
e901145ce8
Changed BATCH_BLOCK back to 100,000.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
2ae117743a
Added comment regarding the new BatchSet import.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
446bed38fc
Using goroutines with BatchSet to speed up the process of importing.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
140ba84e40
Attempt to use the new interface for badger
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
bf56c63448
Deal with the changes of the badger API
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
cc83f5d69e
On the interactive shell, allows searches by either avatar name or UUID. UUID is just a special case of a 36-character string with a valid format, which is checked with a regex.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
d4a4a36251
Adds -nomemory switch to try to reduce memory consumption. This is the default for FastCGI.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
accad7a5e8
Added support for keeping the grid of origin as part of the database entries. This required some JSON marshalling. Added some stopwatches, too, to give an idea how long it takes to include W-Hat’s database.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
b1dbdd9015
Added more information about importing databases.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
2e36cb33eb
Exclude directory where database resides, if it appears on the current directory (basically the default!)
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
04ddfece2c
Works, but keys must be the other way round :(
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
9551eb7d80
First attempt at loading W-Hat database into KV database; currently failing, even though it reads 8 million records or so. The question is why the searches all fail!
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
4a4688b2e5
Persistent KV database files are now properly written on the current working directory (maybe they shouldn’t…); added a ‘compatibility mode’ with W-Hat, namely, if “compat=false” is passed, it send back cute messages; if not, it just sends back the UUID (or avatar name)
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
6dbb45f5ff
Added files from KV database that have to be ignored
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
0b6b681a94
Works flawlessly. TODO(gwyneth): add W-Hat database to pre-fill avatar UUIDs
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
88f263d536
First attempt to open/close the badger KV database.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
5f25aec017
Explain better what external packages are needed and added some limitations of this code and how to improve it in the future.
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
7260eeb5c3
Attempt to get two handlers working under fastcgi, doesn’t seem to be possible :(
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
4a697902ea
Router: Wrong order of handling
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
c4fa5524f2
Small bugs stamped out
|
7 gadi atpakaļ |
Gwyneth Llewelyn
|
bcbe078f35
Skeleton framework to read avatar name & key from a touch.
|
7 gadi atpakaļ |