MPLogger
Multi-processing capable print-like logger for Python
Requirements and Installation
Python 3.8+ is required
Pip
pip install mplogger
Manual
Poetry and (optionally) GNU Make are required.
git clone https://github.com/ELTE-DH/webarticlecurator.git- Run
make
On Windows or without Make (after cloning the repository):
poetry install --no-rootpoetry buildpoetry run pip install --upgrade dist/*.whl(the correct filename must be specified on Windows)
Usage
Single-process
from MLPlogger import Logger
# Initialize logger (default: STDERR only with INFO level)
logger = Logger(log_filename, logfile_mode, logfile_encoding, logfile_level, console_stream, console_level, console_format, file_format)
logger.log('INFO', 'First argument log level as string')
logger.log('WARNING', 'THIS IS A WARNING!', 'In multiple lines', 'just like print()', sep='\n')
logger.log('CRITICAL', 'Can also set line endings!', end='\r\n')
Multi-process
from itertools import repeat
from multiprocessing import Pool, Manager, current_process
from MLPlogger import Logger
def worker_process(par):
state, lq = par
retl = []
for n in range(100):
lq.log('WARNING', f'{current_process().name} message{state} {n}')
lq.log('WARNING', f'{current_process().name} finished')
return retl
log_obj = Logger('test.log', 'w') # Apply all parameters for logger here!
log_obj.log('INFO', 'NORMAL LOG BEGIN') # Normal logging
with Manager() as man:
log_queue = man.Queue()
with log_obj.init_mp_logging_context(log_queue) as mplogger, Pool() as p:
# Here one can log parallel from all processes!
return_queue = p.imap(worker_process, zip(range(10), repeat(mplogger)), chunksize=3)
for _ in return_queue:
pass
log_obj.log('INFO', 'NORMAL LOG END') # Normal logging
Licence
This project is licensed under the terms of the GNU LGPL 3.0 license.
2 Oct 2, 2022
3 Jan 10, 2022
1.5k Jan 6, 2023
365 Nov 11, 2022
43 Dec 27, 2022
17 Jul 17, 2022
795 Dec 18, 2022
13.7k Jan 2, 2023
1.4k Dec 31, 2022
496 Dec 30, 2022
20 Sep 14, 2022
778 Dec 26, 2022
1 Jan 19, 2022
4k Dec 30, 2022
2 Jan 05, 2022
11 May 16, 2022
2 Nov 25, 2021
1 Nov 11, 2021
51 Jan 01, 2023
111 Dec 31, 2022
500 Dec 28, 2022
1.4k Nov 11, 2022
4 Nov 08, 2021
1 Apr 24, 2022
5 May 02, 2022
39 Aug 26, 2022
2 Mar 27, 2022