jUdZddlZddlZddlZddlZddlZddlmZddlm Z m Z ejdk(rddl m ZnddlmZddlmZmZd aej(Zd Zd Zd Zd ZdeddfdZd0dZd0dZeGddej<ZdddddddZ dddddd dde ede ede e!d e e!d!e ed"e"defd#Z#d0d$Z$Gd%d&eZ%dd'd(ejLd)ed*e!d+e!d e!d,ejNd-e ej<ddfd.Z(d/Z)y)1u Centralized logging setup for Hermes Agent. Provides a single ``setup_logging()`` entry point that both the CLI and gateway call early in their startup path. All log files live under ``~/.hermes/logs/`` (profile-aware via ``get_hermes_home()``). Log files produced: agent.log — INFO+, all agent/tool/session activity (the main log) errors.log — WARNING+, errors and warnings only (quick triage) gateway.log — INFO+, gateway-only events (created when mode="gateway") gui.log — INFO+, dashboard/websocket/TUI-gateway events (created when mode="gui") All files use ``RotatingFileHandler`` with ``RedactingFormatter`` so secrets are never written to disk. Component separation: gateway.log only receives records from ``gateway.*`` loggers — platform adapters, session management, slash commands, delivery. gui.log receives dashboard-side records from ``hermes_cli.web_server``, ``hermes_cli.pty_bridge``, ``tui_gateway.*``, and ``uvicorn.*``. agent.log remains the catch-all (everything goes there). Session context: Call ``set_session_context(session_id)`` at the start of a conversation and ``clear_session_context()`` when done. All log lines emitted on that thread will include ``[session_id]`` for filtering/correlation. N)Path)OptionalSequencewin32)ConcurrentRotatingFileHandler)RotatingFileHandler)get_config_pathget_hermes_homeFz>%(asctime)s %(levelname)s%(session_tag)s %(name)s: %(message)szC%(asctime)s - %(name)s - %(levelname)s%(session_tag)s - %(message)sctj}t|ddxsd}|jj dddvr|S t|dd}|#t j |ddd }d |_|S |S#t$rY|SwxYw) uReturn a stderr stream that tolerates Unicode on all platforms. On Windows the console encoding is often a legacy MBCS codec (cp949, cp1252, …) that raises ``UnicodeEncodeError`` for characters like the em-dash (U+2014). We wrap ``sys.stderr`` in a ``TextIOWrapper`` with ``errors='replace'`` so log lines are never lost — un-encodable characters are replaced with ``?`` instead of crashing the process. encodingNutf-8-)utf8utf8surrogateescapebufferreplaceT)r errorsline_bufferingcyNr/home/cube/projects/richard/traning coach/.omo/evidence/nutricoach-v150-combined/st_01a0560c-r63-installed-wheel-first-claim-qa/venv/lib/python3.12/site-packages/hermes_logging.pyz_safe_stderr..osDr) sysstderrgetattrlowerrio TextIOWrapperclose Exception)streamr bufwrappeds r _safe_stderrr'UsZZFvz40;GH~~R(,KK  fh- ?&&  # G)GMN  M   M s1A<< B B )openaizopenai._base_clienthttpxhttpcoreasynciohpackz hpack.hpackgrpcmodalurllib3zurllib3.connectionpool websocketscharset_normalizer markdown_it session_idreturnc|t_y)zSet the session ID for the current thread. All subsequent log records on this thread will include ``[session_id]`` in the formatted output. Call at the start of ``run_conversation()``. N_session_contextr3)r3s rset_session_contextr8s #-rcdt_y)z,Clear the session ID for the current thread.Nr6rrrclear_session_contextr:s "&rctjtddryfd}d|_tj|y)ubReplace the global LogRecord factory with one that adds ``session_tag``. Unlike a ``logging.Filter`` on a handler or logger, the record factory runs for EVERY record in the process — including records that propagate from child loggers and records handled by third-party handlers. This guarantees ``%(session_tag)s`` is always available in format strings, eliminating the KeyError that would occur if a handler used our format without having a ``_SessionFilter`` attached. Idempotent — checks for a marker attribute to avoid double-wrapping if the module is reloaded. _hermes_session_injectorFNcf|i|}ttdd}|r d|d|_|Sd|_|S)Nr3z []r)rr7 session_tag)argskwargsrecordsidcurrent_factorys r_session_record_factoryz@_install_session_record_factory.._session_record_factorysG $1&1& d;,/r#a[ 68 rT)logginggetLogRecordFactoryrr<setLogRecordFactory)rErDs @r_install_session_record_factoryrIsB113O :EB 8<4  78rcVeZdZdZdeeddffd Zdejde fdZ xZ S)_ComponentFilterzOnly pass records whose logger name starts with one of *prefixes*. Used to route gateway-specific records to ``gateway.log`` while keeping ``agent.log`` as the catch-all. prefixesr4NcBt|t||_yr)super__init__tuple _prefixes)selfrL __class__s rrOz_ComponentFilter.__init__s xrrBcL|jj|jSr)name startswithrQ)rRrBs rfilterz_ComponentFilter.filters{{%%dnn55r) __name__ __module__ __qualname____doc__rstrrOrF LogRecordboolrW __classcell__rSs@rrKrKs8 )#)4)6W..646rrK)gatewayhermes_plugins)agent run_agent model_tools batch_runner)tools) hermes_clicli)cron)zhermes_cli.web_serverzhermes_cli.pty_bridge tui_gatewayuvicorn)rarcrgrirjgui) hermes_home log_level max_size_mb backup_countmodeforcernrorprqrrrsc |xs t}|dz }|jddt\}} } |xs|xsdj} t t | t j } |xs| xsddzdz} |xs| xsd}dd lm}t j}t||d z | | ||t t||d z t jd d|t |dk(r=t||dz t j dd|tttd|dk(r=t||dz t j dd|tttdtr|s|S|j t j"k(s|j | kDr|j%| t&D]4}t j|j%t j6da|S)u@Configure the Hermes logging subsystem. Safe to call multiple times — the second call is a no-op unless *force* is ``True``. Parameters ---------- hermes_home Override for the Hermes home directory. Falls back to ``get_hermes_home()`` (profile-aware). log_level Minimum level for the ``agent.log`` file handler. Accepts any standard Python level name (``"DEBUG"``, ``"INFO"``, ``"WARNING"``). Defaults to ``"INFO"`` or the value from config.yaml ``logging.level``. max_size_mb Maximum size of each log file in megabytes before rotation. Defaults to 5 or the value from config.yaml ``logging.max_size_mb``. backup_count Number of rotated backup files to keep. Defaults to 3 or the value from config.yaml ``logging.backup_count``. mode Caller context: ``"cli"``, ``"gateway"``, ``"gui"``, ``"cron"``. When ``"gateway"``, an additional ``gateway.log`` file is created that receives only gateway-component records. When ``"gui"``, an additional ``gui.log`` file is created that receives dashboard and TUI-gateway component records. force Re-run setup even if it has already been called. Returns ------- Path The ``logs/`` directory where files are written. logsTparentsexist_okINFOirRedactingFormatterz agent.log)level max_bytesrq formatterz errors.logi raz gateway.logiP)r~rrqr log_filterrmzgui.logi)r mkdir_read_logging_configupperrrFry agent.redactr} getLogger_add_rotating_handler _LOG_FORMATWARNINGrKCOMPONENT_PREFIXES_logging_initializedr~NOTSETsetLevel_NOISY_LOGGERS)rnrorprqrrrshomelog_dir cfg_level cfg_max_size cfg_backup level_namer~rbackupsr}rootrUs r setup_loggingrsX  +/+DVmG MM$M.+?*@'I|Z2y2F99;J GZ 6E1 1T9D@I-j-AG0    D +$[1  ,oo!$[1  y  m #,,%(5'(:9(EF  u}  i ,,&(5'(:5(AB E zzW^^#tzzE'9 e$((9  Nrcddlm}tj}|jD]=}t |tj st |tr/t|dds=ytj t}|jtj|j|tdd|_|j||j tjkDr|jtjt"D]4}tj|jtj$6tjd jtj&y) zEnable DEBUG-level console logging for ``--verbose`` / ``-v`` mode. Called by ``AIAgent.__init__()`` when ``verbose_logging=True``. rr|_hermes_verboseFNz%H:%M:%S)datefmtTz rex-deploy)rr}rFrhandlers isinstance StreamHandlerrrr'rDEBUG setFormatter_LOG_FORMAT_VERBOSEr addHandlerr~rrry)r}rhhandlerrUs rsetup_verbose_loggingr_s  0    D]] a.. / 1FY8Zq+U3 ##LN3G W]]# +,?TU"GOOG zzGMM! gmm$$((9 l#,,W\\:rcteZdZdZfdZdZd dZd dZdejddffd Z fd Z fd Z xZ S) _ManagedRotatingFileHandleruRotatingFileHandler that ensures group-writable perms in managed mode AND survives external rotation. Two responsibilities: 1. In managed mode (NixOS), the stateDir uses setgid (2770) so new files inherit the hermes group. However, both ``_open()`` (initial creation) and ``doRollover()`` create files via ``open()``, which uses the process umask — typically 0022, producing 0644. This subclass applies ``chmod 0660`` after both operations so the gateway and interactive users can share log files. 2. ``RotatingFileHandler`` keeps an open file descriptor. If anything rotates the file *externally* (``logrotate``, manual ``mv``, another process rotating under us, a transient unlink), our fd keeps pointing at the renamed/unlinked inode and every subsequent write goes to ``gateway.log.1`` instead of ``gateway.log`` — silent log loss for the file every operator expects to read. Before each emit we ``stat`` ``baseFilename`` and compare it against the open stream's inode; on mismatch we reopen. This is the same pattern as stdlib ``WatchedFileHandler.reopenIfNeeded()``, adapted for rotating handlers. cddlm}||_t||i|d|_d|_|jy)Nr) is_managed)hermes_cli.configr_managedrNrO _stat_dev _stat_ino_record_stream_stat)rRr@rArrSs rrOz$_ManagedRotatingFileHandler.__init__s=0"   $)&))-(,   "rc~|jr" tj|jdyy#t$rYywxYw)Ni)roschmod baseFilenameOSError)rRs r_chmod_if_managedz-_ManagedRotatingFileHandler._chmod_if_manageds; == **E2   s 0 <<r4Nc tj|j}|j|jc|_|_y#t$rd\|_|_YywxYw)zHSnapshot dev/ino of ``baseFilename`` so we can detect external rotation.)NNN)rstatrst_devst_inorrrrRsts rrz/_ManagedRotatingFileHandler._record_stream_statsP 8**+B-/YY *DNDN 8-7 *DNDN 8sAAA A cD tj|j}|j |j$|j|jc|_ |_ y|j|jf|j|jfk7rh |j|jj d|_ |j|_|j|jc|_ |_ yy#t$rw |j|jj n#t $rYnwxYwd|_ |j|_|jYy#t $rYYywxYwt$rYywxYw#t $rYwxYw#t $rYywxYw)aaReopen the stream when ``baseFilename`` no longer matches our fd. Triggered when ``baseFilename`` was renamed (logrotate), unlinked, or replaced by a different inode. Silent + best-effort: any error falls back to the existing (possibly stale) stream so logging keeps working instead of dying on a stat failure. N)rrrFileNotFoundErrorr$r"r#_openrrrrrrrs r_reopen_if_externally_rotatedz9_ManagedRotatingFileHandler._reopen_if_externally_rotateds} **+B* >> !T^^%;-/YY *DNDN  IIryy !dnndnn%E E ;;*KK%%'DK "jjl 13BII. F1!  ;;*KK%%'  DK "jjl ((*               swC7&F=8F7 F&D('F( D41F3D44 F?%E&& E3/F2E33 FF FF FFrBc|j)tjj|jr|j t ||yr)r$rpathexistsrrrNemit)rRrBrSs rrz _ManagedRotatingFileHandler.emits< ;; "bggnnT5F5F&G  . . 0  VrcDt|}|j|Sr)rNrr)rRr$rSs rrz!_ManagedRotatingFileHandler._opens   rcbt||j|jyr)rN doRolloverrr)rRrSs rrz&_ManagedRotatingFileHandler.doRollovers(      "rr4N)rXrYrZr[rOrrrrFr]rrrr_r`s@rrrsE0#8/b7,, ##rr)rloggerrr~rrrc|j}|jD]<}t|tst t |ddj|k(s<y|j jddtt|||d} | j|| j||| j||j| y)aAdd a ``RotatingFileHandler`` to *logger*, skipping if one already exists for the same resolved file path (idempotent). Parameters ---------- log_filter Optional filter to attach to the handler (e.g. ``_ComponentFilter`` for gateway.log). rrNTrvr )maxBytes backupCountr )resolverrrrrparentrrr\rr addFilterr) rrr~rrqrrresolvedexistingrs rrrs&||~HOO x!4 5WX~r:;CCEQ  $ KKdT2) D I<G U #*% grc ddl}t}|jrt|dd5}|j |xsi}ddd ddlm}|j}jdi}t|tr2|jd|jd |jd fSy #1swYvxYw#t$rYlwxYw#t$rYy wxYw) uBest-effort read of ``logging.*`` from config.yaml. Returns ``(level, max_size_mb, backup_count)`` — any may be ``None``. rNrr )r ) managed_scoperFr~rprq)NNN) yamlr ropen safe_loadrhrapply_managed_overlayr#getrdict)r config_pathfcfgrlog_cfgs rrr!s  %'    k39QnnQ'-2: 4#99#>ggi,G'4(KK(KK .KK/ %:9      sM,CB9C C$AC9C>C CCCC C C r)*r[r rFrr threadingpathlibrtypingrrplatformconcurrent_log_handlerrrlogging.handlershermes_constantsr r rlocalr7rrr'rr\r8r:rIFilterrKrintr^rrrLogger Formatterrrrrrrs:  %0<<75> #9??$ O [D,-C-D-'9: ! 6w~~ 6$- B    *#'#!%"&u$u}u# u 3- u 3- u u up;Ht#"5t#~,0$ NN$ $  $  $  $  $($ $Nr