Python 在容器化应用程序之前启动Provxy时,Docker运行挂起

Python 在容器化应用程序之前启动Provxy时,Docker运行挂起,python,docker,dockerfile,selenium-firefoxdriver,privoxy,Python,Docker,Dockerfile,Selenium Firefoxdriver,Privoxy,我有一个python FastAPI应用程序,在GKE上的Kubernetes集群中运行。我正试图让集装箱(吊舱)的出站流量通过。为了测试这一点,我正在本地机器上构建/运行容器,但是当我运行docker run-p 8080:8080 privoxy命令时,我得到了挂起在最后一行的以下输出/日志: 2020-09-08 13:32:15.342 7fb59e36de80 Info: Privoxy version 3.0.26 2020-09-08 13:32:15.342 7fb59e36de

我有一个python FastAPI应用程序,在GKE上的Kubernetes集群中运行。我正试图让集装箱(吊舱)的出站流量通过。为了测试这一点,我正在本地机器上构建/运行容器,但是当我运行
docker run-p 8080:8080 privoxy
命令时,我得到了挂起在最后一行的以下输出/日志:

2020-09-08 13:32:15.342 7fb59e36de80 Info: Privoxy version 3.0.26
2020-09-08 13:32:15.342 7fb59e36de80 Info: Program name: privoxy
2020-09-08 13:32:15.344 7fb59e36de80 Info: Loading filter file: /etc/privoxy/default.filter
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading filter file: /etc/privoxy/user.filter
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading actions file: /etc/privoxy/match-all.action
2020-09-08 13:32:15.345 7fb59e36de80 Info: Loading actions file: /etc/privoxy/default.action
2020-09-08 13:32:15.348 7fb59e36de80 Info: Loading actions file: /etc/privoxy/user.action
2020-09-08 13:32:15.348 7fb59e36de80 Info: Listening on port 8118 on IP address 0.0.0.0
我的问题是,“如何在运行时在Docker容器中启动privoxy,然后运行我的应用程序(使用privoxy),而不让privoxy挂起或抛出错误?”

我的Dockerfile如下所示:

FROM continuumio/miniconda3:4.6.14

# ...

# Install Privoxy
RUN set -xe \
    && apt-get update \
    && apt-get install -y privoxy \
    && curl -sSL https://github.com/tianon/gosu/releases/download/1.9/gosu-amd64 > /usr/sbin/gosu \
    && chmod +x /usr/sbin/gosu

RUN sed -i -e '/^listen-address  \[/s/listen-address/#listen-address/' \
           -e '/^enforce-blocks/s/0/1/' \
           -e '/^#debug/s/#//' /etc/privoxy/config
VOLUME /etc/privoxy
EXPOSE 8118

# Install Firefox
RUN apt-get update && \
    apt-get -y install firefox-esr

# Install Geckodriver
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.24.0/geckodriver-v0.24.0-linux64.tar.gz && \
    tar xzf geckodriver-v0.24.0-linux64.tar.gz && \
    mv geckodriver /usr/bin/geckodriver


# ...

CMD start.sh
#!/usr/bin/env bash
gosu privoxy privoxy --no-daemon /etc/privoxy/config
cd /code
python app.py
#!/usr/bin/env bash
/etc/init.d/privoxy start --no-daemon
cd /code
python app.py
start.sh
如下所示:

FROM continuumio/miniconda3:4.6.14

# ...

# Install Privoxy
RUN set -xe \
    && apt-get update \
    && apt-get install -y privoxy \
    && curl -sSL https://github.com/tianon/gosu/releases/download/1.9/gosu-amd64 > /usr/sbin/gosu \
    && chmod +x /usr/sbin/gosu

RUN sed -i -e '/^listen-address  \[/s/listen-address/#listen-address/' \
           -e '/^enforce-blocks/s/0/1/' \
           -e '/^#debug/s/#//' /etc/privoxy/config
VOLUME /etc/privoxy
EXPOSE 8118

# Install Firefox
RUN apt-get update && \
    apt-get -y install firefox-esr

# Install Geckodriver
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.24.0/geckodriver-v0.24.0-linux64.tar.gz && \
    tar xzf geckodriver-v0.24.0-linux64.tar.gz && \
    mv geckodriver /usr/bin/geckodriver


# ...

CMD start.sh
#!/usr/bin/env bash
gosu privoxy privoxy --no-daemon /etc/privoxy/config
cd /code
python app.py
#!/usr/bin/env bash
/etc/init.d/privoxy start --no-daemon
cd /code
python app.py
启动webdriver/Selenium时,我使用以下功能:

from selenium import webdriver
from selenium.webdriver.firefox.options import Options as FFOptions
from selenium.webdriver.firefox.webdriver import WebDriver as FirefoxWebDriver

def get_container_firefox_driver(windows_mask: bool=True):
    # create a new FireFox session
    os.environ['MOZ_FORCE_DISABLE_E10S'] = '1'

    ff_options = FFOptions()
    ff_options.add_argument('-new-instance')
    ff_options.add_argument('-headless')

    ff_profile = webdriver.FirefoxProfile()
    # set some privacy settings
    ff_profile.set_preference("places.history.enabled", False)
    ff_profile.set_preference("privacy.clearOnShutdown.offlineApps", True)
    ff_profile.set_preference("privacy.clearOnShutdown.passwords", True)
    ff_profile.set_preference("privacy.clearOnShutdown.siteSettings", True)
    ff_profile.set_preference("privacy.sanitize.sanitizeOnShutdown", True)
    ff_profile.set_preference("signon.rememberSignons", False)
    ff_profile.set_preference("network.cookie.lifetimePolicy", 2)
    ff_profile.set_preference("network.dns.disablePrefetch", True)
    ff_profile.set_preference("network.http.sendRefererHeader", 0)

    # set socks proxy
    ff_profile.set_preference("network.proxy.type", 1)
    ff_profile.set_preference("network.proxy.socks_version", 5)
    ff_profile.set_preference("network.proxy.socks", '127.0.0.1')
    ff_profile.set_preference("network.proxy.socks_port", 8118)
    ff_profile.set_preference("network.proxy.socks_remote_dns", True)

    # get a speed increase by not downloading images
    ff_profile.set_preference("permissions.default.image", 2)

    driver = webdriver.Firefox(
        firefox_profile=ff_profile,
        options=ff_options,
        executable_path="/usr/bin/geckodriver",
    )
    return driver
其他尝试 我还尝试过在Dockerfile中使用此
sed
命令,不注释privoxy配置文件的
listen address[::1]:8118
行:

RUN sed -i -e '/^enforce-blocks/s/0/1/' \
           -e '/^#debug/s/#//' /etc/privoxy/config
。。。但当我这样做时,当privoxy在容器中启动时,我会得到以下“致命错误”:

2020-09-08 14:21:16.844 7fa4d8646e80 Info: Privoxy version 3.0.26
2020-09-08 14:21:16.844 7fa4d8646e80 Info: Program name: privoxy
2020-09-08 14:21:16.845 7fa4d8646e80 Info: Loading filter file: /etc/privoxy/default.filter
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading filter file: /etc/privoxy/user.filter
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/match-all.action
2020-09-08 14:21:16.847 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/default.action
2020-09-08 14:21:16.849 7fa4d8646e80 Info: Loading actions file: /etc/privoxy/user.action
2020-09-08 14:21:16.850 7fa4d8646e80 Info: Listening on port 8118 on IP address 127.0.0.1
2020-09-08 14:21:16.850 7fa4d8646e80 Fatal error: can't bind to ::1:8118: Cannot assign requested address

根据所使用的操作系统,privoxy的启动命令不正确。对于debian linux操作系统,启动命令应该是
/etc/init.d/privoxy start--no daemon
。此外,此命令之前的
gosu
命令不是必需的,将使privoxy启动崩溃。start.sh应该如下所示:

FROM continuumio/miniconda3:4.6.14

# ...

# Install Privoxy
RUN set -xe \
    && apt-get update \
    && apt-get install -y privoxy \
    && curl -sSL https://github.com/tianon/gosu/releases/download/1.9/gosu-amd64 > /usr/sbin/gosu \
    && chmod +x /usr/sbin/gosu

RUN sed -i -e '/^listen-address  \[/s/listen-address/#listen-address/' \
           -e '/^enforce-blocks/s/0/1/' \
           -e '/^#debug/s/#//' /etc/privoxy/config
VOLUME /etc/privoxy
EXPOSE 8118

# Install Firefox
RUN apt-get update && \
    apt-get -y install firefox-esr

# Install Geckodriver
RUN wget https://github.com/mozilla/geckodriver/releases/download/v0.24.0/geckodriver-v0.24.0-linux64.tar.gz && \
    tar xzf geckodriver-v0.24.0-linux64.tar.gz && \
    mv geckodriver /usr/bin/geckodriver


# ...

CMD start.sh
#!/usr/bin/env bash
gosu privoxy privoxy --no-daemon /etc/privoxy/config
cd /code
python app.py
#!/usr/bin/env bash
/etc/init.d/privoxy start --no-daemon
cd /code
python app.py
注释掉带有
运行sed-i-e'/^listen address\[/s/listen address/#listen address/…
侦听地址[::1]:8118
行可以防止在privoxy启动期间出现致命错误,因此应该使用它