13.2.6. Setting up logging — MDAnalysis.lib.log
¶
Configure logging for MDAnalysis. Import this module if logging is desired in application code.
Logging to a file and the console is set up by default as described under logging to multiple destinations.
The top level logger of the library is named MDAnalysis by
convention; a simple logger that writes to the console and logfile can
be created with the create()
function. This only has to be done
once. For convenience, the default MDAnalysis logger can be created
with MDAnalysis.start_logging()
:
import MDAnalysis
MDAnalysis.start_logging()
Once this has been done, MDAnalysis will write messages to the logfile
(named MDAnalysis.log by default but this can be changed with the
optional argument to start_logging()
).
Any code can log to the MDAnalysis logger by using
import logging
logger = logging.getLogger('MDAnalysis.MODULENAME')
# use the logger, for example at info level:
logger.info("Starting task ...")
The important point is that the name of the logger begins with “MDAnalysis.”.
Note
The logging
module in the standard library contains in depth
documentation about using logging.
13.2.6.1. Convenience functions¶
Two convenience functions at the top level make it easy to start and stop the default MDAnalysis logger.
13.2.6.2. Other functions and classes for logging purposes¶
Changed in version 2.0.0: Deprecated MDAnalysis.lib.log.ProgressMeter
has now been removed.
-
class
MDAnalysis.lib.log.
NullHandler
(level=0)[source]¶ Silent Handler.
Useful as a default:
h = NullHandler() logging.getLogger("MDAnalysis").addHandler(h) del h
see the advice on logging and libraries in http://docs.python.org/library/logging.html?#configuring-logging-for-a-library
Initializes the instance - basically setting the formatter to None and the filter list to empty.
-
class
MDAnalysis.lib.log.
ProgressBar
(*args, **kwargs)[source]¶ Display a visual progress bar and time estimate.
The
ProgressBar
decorates an iterable object, returning an iterator which acts exactly like the original iterable, but prints a dynamically updating progressbar every time a value is requested. See the example below for how to use it when iterating over the frames of a trajectory.Parameters: - iterable (iterable, optional) – Iterable to decorate with a progressbar. Leave blank to manually manage the updates.
- verbose (bool, optional) – If
True
(the default) then show the progress bar, unless the disable keyword is set toTrue
(disable takes precedence over verbose). If verbose is set toNone
then the progress bar is displayed (likeTrue
), unless this is a non-TTY output device (see disable). - desc (str, optional) – Prefix for the progressbar.
- total (int or float, optional) – The number of expected iterations. If unspecified,
len(iterable)
is used if possible. Iffloat("inf")
or as a last resort, only basic progress statistics are displayed (no ETA, no progressbar). - leave (bool, optional) – If [default:
True
], keeps all traces of the progressbar upon termination of iteration. IfNone
, will leave only if position is 0. - file (
io.TextIOWrapper
orio.StringIO
, optional) – Specifies where to output the progress messages (default:sys.stderr
). Usesfile.write()
andfile.flush()
methods. For encoding, see write_bytes. - ncols (int, optional) – The width of the entire output message. If specified, dynamically resizes the progressbar to stay within this bound. If unspecified, attempts to use environment width. The fallback is a meter width of 10 and no limit for the counter and statistics. If 0, will not print any meter (only stats).
- mininterval (float, optional) – Minimum progress display update interval [default: 0.1] seconds.
- maxinterval (float, optional) – Maximum progress display update interval [default: 10] seconds. Automatically adjusts miniters to correspond to mininterval after long display update lag. Only works if dynamic_miniters or monitor thread is enabled.
- miniters (int or float, optional) – Minimum progress display update interval, in iterations. If 0 and dynamic_miniters, will automatically adjust to equal mininterval (more CPU efficient, good for tight loops). If > 0, will skip display of specified number of iterations. Tweak this and mininterval to get very efficient loops. If your progress is erratic with both fast and slow iterations (network, skipping items, etc) you should set miniters=1.
- ascii (bool or str, optional) – If unspecified or
False
, use unicode (smooth blocks) to fill the meter. The fallback is to use ASCII characters ” 123456789#”. - disable (bool, optional) – Whether to disable the entire progressbar wrapper
[default:
False
]. If set to None, disable on non-TTY. - unit (str, optional) – String that will be used to define the unit of each iteration [default: it].
- unit_scale (bool or int or float, optional) – If 1 or True, the number of iterations will be reduced/scaled
automatically and a metric prefix following the
International System of Units standard will be added
(kilo, mega, etc.) [default:
False
]. If any other non-zero number, will scale total and n. - dynamic_ncols (bool, optional) – If set, constantly alters ncols and nrows to the
environment (allowing for window resizes) [default:
False
]. - smoothing (float, optional) – Exponential moving average smoothing factor for speed estimates (ignored in GUI mode). Ranges from 0 (average speed) to 1 (current/instantaneous speed) [default: 0.3].
- bar_format (str, optional) –
Specify a custom bar string formatting. May impact performance. [default:
'{l_bar}{bar}{r_bar}'
], wherel_bar='{desc}: {percentage:3.0f}%|'
andr_bar='| {n_fmt}/{total_fmt} [{elapsed}<{remaining}, {rate_fmt}{postfix}]'
Possible vars: l_bar, bar, r_bar, n, n_fmt, total, total_fmt, percentage, elapsed, elapsed_s, ncols, nrows, desc, unit, rate, rate_fmt, rate_noinv, rate_noinv_fmt, rate_inv, rate_inv_fmt, postfix, unit_divisor, remaining, remaining_s.
Note that a trailing “: ” is automatically removed after {desc} if the latter is empty.
- initial (int or float, optional) – The initial counter value. Useful when restarting a progress bar
[default: 0]. If using
float
, consider specifying{n:.3f}
or similar in bar_format, or specifying unit_scale. - position (int, optional) – Specify the line offset to print this bar (starting from 0) Automatic if unspecified. Useful to manage multiple bars at once (e.g., from threads).
- postfix (dict or *, optional) – Specify additional stats to display at the end of the bar.
Calls
set_postfix(**postfix)
if possible (dict
). - unit_divisor (float, optional) – [default: 1000], ignored unless unit_scale is
True
. - write_bytes (bool, optional) – If (default:
None
) and file is unspecified, bytes will be written in Python 2. If True will also write bytes. In all other cases will default to unicode. - lock_args (tuple, optional) – Passed to refresh for intermediate output (initialisation, iterating, and updating).
- nrows (int, optional) – The screen height. If specified, hides nested bars outside this bound. If unspecified, attempts to use environment height. The fallback is 20.
Returns: out
Return type: decorated iterator.
Example
To get a progress bar when analyzing a trajectory:
from MDAnalysis.lib.log import ProgressBar ... for ts in ProgressBar(u.trajectory): # perform analysis
will produce something similar to
30%|███████████ | 3/10 [00:13<00:30, 4.42s/it]
in a terminal or Jupyter notebook.
See also
The
ProgressBar
is derived fromtqdm.auto.tqdm
; see the tqdm documentation for further details on how to use it.
-
MDAnalysis.lib.log.
clear_handlers
(logger)[source]¶ clean out handlers in the library top level logger
(only important for reload/debug cycles…)
-
MDAnalysis.lib.log.
create
(logger_name='MDAnalysis', logfile='MDAnalysis.log')[source]¶ Create a top level logger.
- The file logger logs everything (including DEBUG).
- The console logger only logs INFO and above.
Logging to a file and the console as described under logging to multiple destinations.
The top level logger of MDAnalysis is named MDAnalysis. Note that we are configuring this logger with console output. If a root logger also does this then we will get two output lines to the console.