Page MenuHomePhabricator

Allow verbosity of Aphlict log to be reduced
Closed, ResolvedPublic

Description

Our Aphlict host ran out of disk space recently. It seems that the reason for this is that the Aphlict log file become very large (> 5GB) after around one month of uptime. I am in the process of setting log rotation for this log file, but it would be nice if the verbosity of the Aphlict log file could be reduced as well. It looks like it is currently quite verbose:

[10-Jul-2017 05:56:26 Etc/UTC] Caught signal SIGINT, exiting.
[7/10/2017, 5:56:27 AM] Configuration test OK.
[7/10/2017, 5:56:27 AM] Starting servers (service PID 12096).
[7/10/2017, 5:56:27 AM] Logging to "/var/log/phabricator/aphlict.log".
[7/10/2017, 5:56:27 AM] Started client server (Port 22280, No SSL).
[7/10/2017, 5:56:27 AM] Started admin server (Port 22281, No SSL).
[7/10/2017, 5:56:27 AM] This server has fingerprint "LXk6PBMEGtsQLCqG".
[7/10/2017, 5:56:27 AM] <Listener/1/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/2/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/3/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/4/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/5/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/6/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/7/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/8/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/9/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/10/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/11/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/12/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/13/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/14/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/15/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/16/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/17/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/18/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/19/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/20/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/21/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/22/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/23/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/24/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/25/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/26/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/27/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/28/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/29/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/30/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/31/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/1/default> Received message: {"command":"subscribe","data":["PHID-TASK-u34atzi5taevvbavshtl","PHID-USER-7ti35ofkzpizyfxcntfo"]}
[7/10/2017, 5:56:27 AM] <Listener/1/default> Subscribed to: ["PHID-TASK-u34atzi5taevvbavshtl","PHID-USER-7ti35ofkzpizyfxcntfo"]
[7/10/2017, 5:56:27 AM] <Listener/32/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/33/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/34/default> Connected from 10.50.0.85.
[7/10/2017, 5:56:27 AM] <Listener/2/default> Received message: {"command":"subscribe","data":["PHID-DREV-2nzdcywcd6gxeokajwxd","PHID-USER-phclfke64ua7v35g7lt5"]}
[7/10/2017, 5:56:27 AM] <Listener/2/default> Subscribed to: ["PHID-DREV-2nzdcywcd6gxeokajwxd","PHID-USER-phclfke64ua7v35g7lt5"]
[7/10/2017, 5:56:27 AM] <Listener/3/default> Received message: {"command":"subscribe","data":["PHID-TASK-wntjr2rajx3komvdz4dv","PHID-USER-friehgd2begnonxd7gov"]}
[7/10/2017, 5:56:27 AM] <Listener/3/default> Subscribed to: ["PHID-TASK-wntjr2rajx3komvdz4dv","PHID-USER-friehgd2begnonxd7gov"]
[7/10/2017, 5:56:27 AM] <Listener/1/default> Received message: {"command":"subscribe","data":["PHID-PROJ-spo7wosf5kjjw7h2ebsu","PHID-USER-7ti35ofkzpizyfxcntfo"]}
[7/10/2017, 5:56:27 AM] <Listener/1/default> Subscribed to: ["PHID-PROJ-spo7wosf5kjjw7h2ebsu","PHID-USER-7ti35ofkzpizyfxcntfo"]
[7/10/2017, 5:56:27 AM] <Listener/6/default> Received message: {"command":"subscribe","data":["PHID-TASK-vaqwf74ehugvcil27elh","PHID-USER-dqhbdl7yo26wh5auei2i"]}
[7/10/2017, 5:56:27 AM] <Listener/6/default> Subscribed to: ["PHID-TASK-vaqwf74ehugvcil27elh","PHID-USER-dqhbdl7yo26wh5auei2i"]
[7/10/2017, 5:56:27 AM] <Listener/8/default> Received message: {"command":"subscribe","data":["PHID-DREV-ruaftdddvikoa6mphj7t","PHID-USER-7zlylpnc7kdxrdpvz26n"]}
[7/10/2017, 5:56:27 AM] <Listener/8/default> Subscribed to: ["PHID-DREV-ruaftdddvikoa6mphj7t","PHID-USER-7zlylpnc7kdxrdpvz26n"]
[7/10/2017, 5:56:27 AM] <Listener/9/default> Received message: {"command":"subscribe","data":["PHID-DREV-zsa7lgjgwxcht3rivgig","PHID-USER-5op3f3byio3euqojnk4s"]}
[7/10/2017, 5:56:27 AM] <Listener/9/default> Subscribed to: ["PHID-DREV-zsa7lgjgwxcht3rivgig","PHID-USER-5op3f3byio3euqojnk4s"]
[7/10/2017, 5:56:27 AM] <Listener/10/default> Received message: {"command":"subscribe","data":["PHID-DREV-4v5lqmgsgcdli4jegxtr","PHID-USER-acnj3bhev7e4qkfqpj7h"]}
[7/10/2017, 5:56:27 AM] <Listener/10/default> Subscribed to: ["PHID-DREV-4v5lqmgsgcdli4jegxtr","PHID-USER-acnj3bhev7e4qkfqpj7h"]
[7/10/2017, 5:56:27 AM] <Listener/11/default> Received message: {"command":"subscribe","data":["PHID-DREV-xaczu7ftfr7xqb4vldij","PHID-USER-z7sg54hs52a7kroty3r2"]}
[7/10/2017, 5:56:27 AM] <Listener/11/default> Subscribed to: ["PHID-DREV-xaczu7ftfr7xqb4vldij","PHID-USER-z7sg54hs52a7kroty3r2"]
[7/10/2017, 5:56:27 AM] <Listener/12/default> Received message: {"command":"subscribe","data":["PHID-USER-lg3fygxwlzxl3fku54hy"]}
[7/10/2017, 5:56:27 AM] <Listener/12/default> Subscribed to: ["PHID-USER-lg3fygxwlzxl3fku54hy"]
[7/10/2017, 5:56:27 AM] <Listener/4/default> Received message: {"command":"subscribe","data":["PHID-TASK-ggzyl4555sc5teanvpdk","PHID-USER-5op3f3byio3euqojnk4s"]}
[7/10/2017, 5:56:27 AM] <Listener/4/default> Subscribed to: ["PHID-TASK-ggzyl4555sc5teanvpdk","PHID-USER-5op3f3byio3euqojnk4s"]
[7/10/2017, 5:56:27 AM] <Listener/5/default> Received message: {"command":"subscribe","data":["PHID-USER-abzwhc667osh5mwd4gk7"]}
[7/10/2017, 5:56:27 AM] <Listener/5/default> Subscribed to: ["PHID-USER-abzwhc667osh5mwd4gk7"]
[7/10/2017, 5:56:27 AM] <Listener/25/default> Received message: {"command":"subscribe","data":["PHID-TASK-vim3uguyt4zrpu5xsbxx","PHID-USER-nxqtqlbfpajvtvr5mnsn"]}
[7/10/2017, 5:56:27 AM] <Listener/25/default> Subscribed to: ["PHID-TASK-vim3uguyt4zrpu5xsbxx","PHID-USER-nxqtqlbfpajvtvr5mnsn"]
[7/10/2017, 5:56:27 AM] <Listener/27/default> Received message: {"command":"subscribe","data":["PHID-DREV-g7rmp4zbwv3sq25n5wuw","PHID-USER-lz4sb5qbtaardduusjud"]}
[7/10/2017, 5:56:27 AM] <Listener/27/default> Subscribed to: ["PHID-DREV-g7rmp4zbwv3sq25n5wuw","PHID-USER-lz4sb5qbtaardduusjud"]
[7/10/2017, 5:56:27 AM] <Listener/30/default> Received message: {"command":"subscribe","data":["PHID-DREV-uzwpdvfnqixsmn6ofiv6","PHID-USER-33p4t2yivepvyztg7amr"]}
[7/10/2017, 5:56:27 AM] <Listener/30/default> Subscribed to: ["PHID-DREV-uzwpdvfnqixsmn6ofiv6","PHID-USER-33p4t2yivepvyztg7amr"]
[7/10/2017, 5:56:27 AM] <Listener/31/default> Received message: {"command":"subscribe","data":["PHID-DREV-up5hq7jhj2ex2ekvp5ij","PHID-USER-2464c22rg3kqlgjqc4m2"]}
[7/10/2017, 5:56:27 AM] <Listener/31/default> Subscribed to: ["PHID-DREV-up5hq7jhj2ex2ekvp5ij","PHID-USER-2464c22rg3kqlgjqc4m2"]
[7/10/2017, 5:56:27 AM] <Listener/24/default> Received message: {"command":"subscribe","data":["PHID-TASK-cz6s5thnpvvmnwergl4a","PHID-USER-q2zc6dtm6uvbjqsxzut6"]}
[7/10/2017, 5:56:27 AM] <Listener/24/default> Subscribed to: ["PHID-TASK-cz6s5thnpvvmnwergl4a","PHID-USER-q2zc6dtm6uvbjqsxzut6"]
[7/10/2017, 5:56:27 AM] <Listener/35/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/36/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/37/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/38/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/39/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/40/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/41/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/42/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/43/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/44/default> Connected from 10.50.0.7.
[7/10/2017, 5:56:27 AM] <Listener/1/default> Received message: {"command":"subscribe","data":["PHID-TASK-iqg6g77mzev7p3l3w2zp","PHID-USER-7ti35ofkzpizyfxcntfo"]}
[7/10/2017, 5:56:27 AM] <Listener/1/default> Subscribed to: ["PHID-TASK-iqg6g77mzev7p3l3w2zp","PHID-USER-7ti35ofkzpizyfxcntfo"]
[7/10/2017, 5:56:27 AM] <Listener/6/default> Received message: {"command":"subscribe","data":["PHID-DREV-5i5kw2s2d4p7cpvmky6k","PHID-USER-dqhbdl7yo26wh5auei2i"]}
[7/10/2017, 5:56:27 AM] <Listener/6/default> Subscribed to: ["PHID-DREV-5i5kw2s2d4p7cpvmky6k","PHID-USER-dqhbdl7yo26wh5auei2i"]
[7/10/2017, 5:56:27 AM] <Listener/8/default> Received message: {"command":"subscribe","data":["PHID-TASK-s7wvpruruhsudbd7brzc","PHID-USER-7zlylpnc7kdxrdpvz26n"]}
[7/10/2017, 5:56:27 AM] <Listener/8/default> Subscribed to: ["PHID-TASK-s7wvpruruhsudbd7brzc","PHID-USER-7zlylpnc7kdxrdpvz26n"]
[7/10/2017, 5:56:27 AM] <Listener/10/default> Received message: {"command":"subscribe","data":["PHID-DREV-4v5lqmgsgcdli4jegxtr","PHID-USER-acnj3bhev7e4qkfqpj7h"]}
[7/10/2017, 5:56:27 AM] <Listener/10/default> Subscribed to: ["PHID-DREV-4v5lqmgsgcdli4jegxtr","PHID-USER-acnj3bhev7e4qkfqpj7h"]
[7/10/2017, 5:56:27 AM] <Listener/11/default> Received message: {"command":"subscribe","data":["PHID-USER-z7sg54hs52a7kroty3r2"]}
[7/10/2017, 5:56:27 AM] <Listener/11/default> Subscribed to: ["PHID-USER-z7sg54hs52a7kroty3r2"]
[7/10/2017, 5:56:27 AM] <Listener/4/default> Received message: {"command":"subscribe","data":["PHID-DREV-favjwurhejoymfffptsu","PHID-USER-5op3f3byio3euqojnk4s"]}
[7/10/2017, 5:56:27 AM] <Listener/4/default> Subscribed to: ["PHID-DREV-favjwurhejoymfffptsu","PHID-USER-5op3f3byio3euqojnk4s"]
[7/10/2017, 5:56:27 AM] <Listener/5/default> Received message: {"command":"subscribe","data":["PHID-PROJ-ytmn33u2eoqzvqrrkx4p","PHID-USER-abzwhc667osh5mwd4gk7"]}
[7/10/2017, 5:56:27 AM] <Listener/5/default> Subscribed to: ["PHID-PROJ-ytmn33u2eoqzvqrrkx4p","PHID-USER-abzwhc667osh5mwd4gk7"]

Our Aphlict configuration is as follows:

/usr/local/src/phabricator/conf/aphlict/aphlict.custom.json
{
  "servers": [
    {
      "listen": "0.0.0.0",
      "port": 22280,
      "type": "client"
    },
    {
      "listen": "0.0.0.0",
      "port": 22281,
      "type": "admin"
    }
  ],
  "logs": [
    {
      "path": "/var/log/phabricator/aphlict.log"
    }
  ],
  "pidfile": "/run/phabricator/aphlict.pid"
}
`

Version Information

Event Timeline

epriestley claimed this task.
epriestley added a subscriber: epriestley.

I think this was at least approximately resolved by D21115, which made the default log much quieter and the "debug" log more verbose.