Huey-消息队列

pip install huey

yum install sqlite -y

# 启动 Redis
redis-server /etc/redis.conf

# 启动 Huey 命令
huey_consumer.py huey_task.huey -l /var/log/app.huey.log -k process -w 2 -q -c 100 -m 10 -v

# 运行 指定task任务
python huey_main.py

(env) [scfan@scfan huey]$ huey_consumer.py huey_main.huey -k process -w 2  1

[2019-10-04 17:46:21,985] INFO:huey.consumer:11137:Huey consumer started with 2 process, PID 11137 at 2019-10-04 09:46:21.985333
[2019-10-04 17:46:21,985] INFO:huey.consumer:11137:Scheduler runs every 1 second(s).
[2019-10-04 17:46:21,985] INFO:huey.consumer:11137:Periodic tasks are enabled.
[2019-10-04 17:46:21,986] INFO:huey.consumer:11137:The following commands are available:
+ huey_task.add_numbers_10
+ huey_task.add_numbers_20

ResponseError: DENIED Redis is running in protected mode because protected mode is enabled, no bind address was specified, no authentication password is requested to clients. In this mode connections are only accepted from the loopback interface. If you want to connect from external computers to Redis you may adopt one of the following solutions: 1) Just disable protected mode sending the command 'CONFIG SET protected-mode no' from the loopback interface by connecting to Redis from the same host the server is running, however MAKE SURE Redis is not publicly accessible from internet if you do so. Use CONFIG REWRITE to make this change permanent. 2) Alternatively you can just disable the protected mode by editing the Redis configuration file, and setting the protected mode option to 'no', and then restarting the server. 3) If you started the server manually just for testing, restart it with the '--protected-mode no' option. 4) Setup a bind address or an authentication password. NOTE: You only need to do one of the above things in order for the server to start accepting connections from the outside.
[2019-10-04 10:31:51,683] ERROR:huey.consumer.Worker:32427:Error reading from queue
Traceback (most recent call last):
  File "/home/scfan/env/lib/python2.7/site-packages/huey/consumer.py", line 94, in loop
    task = self.huey.dequeue()
  File "/home/scfan/env/lib/python2.7/site-packages/huey/api.py", line 282, in dequeue
    data = self.storage.dequeue()
  File "/home/scfan/env/lib/python2.7/site-packages/huey/storage.py", line 423, in dequeue
    timeout=self.read_timeout)[1]
  File "/home/scfan/env/lib/python2.7/site-packages/redis/client.py", line 1635, in brpop
    return self.execute_command('BRPOP', *keys)
  File "/home/scfan/env/lib/python2.7/site-packages/redis/client.py", line 839, in execute_command
    return self.parse_response(conn, command_name, **options)
  File "/home/scfan/env/lib/python2.7/site-packages/redis/client.py", line 853, in parse_response
    response = connection.read_response()
  File "/home/scfan/env/lib/python2.7/site-packages/redis/connection.py", line 717, in read_response
    raise response
ResponseError: DENIED Redis is running in protected mode because protected mode is enabled, no bind address was specified, no authentication password is requested to clients. In this mode connections are only accepted from the loopback interface. If you want to connect from external computers to Redis you may adopt one of the following solutions: 1) Just disable protected mode sending the command 'CONFIG SET protected-mode no' from the loopback interface by connecting to Redis from the same host the server is running, however MAKE SURE Redis is not publicly accessible from internet if you do so. Use CONFIG REWRITE to make this change permanent. 2) Alternatively you can just disable the protected mode by editing the Redis configuration file, and setting the protected mode option to 'no', and then restarting the server. 3) If you started the server manually just for testing, restart it with the '--protected-mode no' option. 4) Setup a bind address or an authentication password. NOTE: You only need to do one of the above things in order for the server to start accepting connections from the outside.

redis启动警告问题：WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.

# 临时修改
echo 511 > /proc/sys/net/core/somaxconn
# 永久修改
echo "net.core.somaxconn= 1024" >> /etc/sysctl.conf
# 使其生效
sysctl -p
# 重启 Redis 服务