将docker映像重置为初始状态
我是docker的新手,最近我尝试使用安装程序。我尝试了手动安装,方法是克隆项目并运行将docker映像重置为初始状态,docker,Docker,我是docker的新手,最近我尝试使用安装程序。我尝试了手动安装,方法是克隆项目并运行docker build-t SampleMap和docker run-v openstreetmap data:/var/lib/postgresql/10/main SampleMap import,然后运行适当的命令来运行容器。我使用docker image ls获得了三张图像: ubuntu none SampleMap 一切顺利。接下来,我尝试删除数据库,并对一个新映射(另一个.osm.pbf文件)
docker build-t SampleMap
和docker run-v openstreetmap data:/var/lib/postgresql/10/main SampleMap import
,然后运行适当的命令来运行容器。我使用docker image ls获得了三张图像:
ubuntu
none
SampleMap
一切顺利。接下来,我尝试删除数据库,并对一个新映射(另一个.osm.pbf
文件)执行整个过程。我删除了imageSampleMap
(使用docker image rm
)并尝试再次执行整个过程,但问题是所有的DB表仍然存在。似乎所有的更改都写入了Ubuntu映像,而不是SampleMap
。我通常会问,有没有什么方法可以将整个Ubuntu映像重置为初始状态?看起来所有的改变在Ubuntu映像中都是永久的
以下是Dockerfile:
FROM ubuntu:18.04
# Based on
# https://switch2osm.org/manually-building-a-tile-server-18-04-lts/
# Set up environment
ENV TZ=UTC
ENV AUTOVACUUM=on
ENV UPDATES=disabled
RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone
# Install dependencies
RUN echo "deb [ allow-insecure=yes ] http://apt.postgresql.org/pub/repos/apt/ bionic-pgdg main" >> /etc/apt/sources.list.d/pgdg.list \
&& apt-get update \
&& apt-get install -y apt-transport-https ca-certificates \
&& apt-get install -y --no-install-recommends --allow-unauthenticated \
apache2 \
apache2-dev \
autoconf \
build-essential \
bzip2 \
cmake \
fonts-noto-cjk \
fonts-noto-hinted \
fonts-noto-unhinted \
clang \
gdal-bin \
git-core \
libagg-dev \
libboost-all-dev \
libbz2-dev \
libcairo-dev \
libcairomm-1.0-dev \
libexpat1-dev \
libfreetype6-dev \
libgdal-dev \
libgeos++-dev \
libgeos-dev \
libgeotiff-epsg \
libicu-dev \
liblua5.3-dev \
libmapnik-dev \
libpq-dev \
libproj-dev \
libprotobuf-c0-dev \
libtiff5-dev \
libtool \
libxml2-dev \
lua5.3 \
make \
mapnik-utils \
nodejs \
npm \
postgis \
postgresql-10 \
postgresql-10-postgis-2.5 \
postgresql-10-postgis-2.5-scripts \
postgresql-contrib-10 \
protobuf-c-compiler \
python-mapnik \
sudo \
tar \
ttf-unifont \
unzip \
wget \
zlib1g-dev \
osmosis \
osmium-tool \
cron \
python3-psycopg2 python3-shapely python3-lxml \
&& apt-get clean autoclean \
&& apt-get autoremove --yes \
&& rm -rf /var/lib/{apt,dpkg,cache,log}/
# Set up renderer user
RUN adduser --disabled-password --gecos "" renderer
USER renderer
# Install latest osm2pgsql
RUN mkdir /home/renderer/src
WORKDIR /home/renderer/src
RUN git clone https://github.com/openstreetmap/osm2pgsql.git
WORKDIR /home/renderer/src/osm2pgsql
RUN mkdir build
WORKDIR /home/renderer/src/osm2pgsql/build
RUN cmake .. \
&& make -j $(nproc)
USER root
RUN make install
USER renderer
# Install and test Mapnik
RUN python -c 'import mapnik'
# Install mod_tile and renderd
WORKDIR /home/renderer/src
RUN git clone -b switch2osm https://github.com/SomeoneElseOSM/mod_tile.git
WORKDIR /home/renderer/src/mod_tile
RUN ./autogen.sh \
&& ./configure \
&& make -j $(nproc)
USER root
RUN make -j $(nproc) install \
&& make -j $(nproc) install-mod_tile \
&& ldconfig
USER renderer
# Configure stylesheet
WORKDIR /home/renderer/src
RUN git clone https://github.com/gravitystorm/openstreetmap-carto.git
WORKDIR /home/renderer/src/openstreetmap-carto
USER root
RUN npm install -g carto
USER renderer
RUN carto project.mml > mapnik.xml
# Load shapefiles
WORKDIR /home/renderer/src/openstreetmap-carto
RUN scripts/get-shapefiles.py
# Configure renderd
USER root
RUN sed -i 's/renderaccount/renderer/g' /usr/local/etc/renderd.conf \
&& sed -i 's/hot/tile/g' /usr/local/etc/renderd.conf
USER renderer
# Configure Apache
USER root
RUN mkdir /var/lib/mod_tile \
&& chown renderer /var/lib/mod_tile \
&& mkdir /var/run/renderd \
&& chown renderer /var/run/renderd
RUN echo "LoadModule tile_module /usr/lib/apache2/modules/mod_tile.so" >> /etc/apache2/conf-available/mod_tile.conf \
&& a2enconf mod_tile
COPY apache.conf /etc/apache2/sites-available/000-default.conf
COPY leaflet-demo.html /var/www/html/index.html
RUN ln -sf /proc/1/fd/1 /var/log/apache2/access.log \
&& ln -sf /proc/1/fd/2 /var/log/apache2/error.log
# Configure PosgtreSQL
COPY postgresql.custom.conf.tmpl /etc/postgresql/10/main/
RUN chown -R postgres:postgres /var/lib/postgresql \
&& chown postgres:postgres /etc/postgresql/10/main/postgresql.custom.conf.tmpl \
&& echo "\ninclude 'postgresql.custom.conf'" >> /etc/postgresql/10/main/postgresql.conf
# copy update scripts
COPY openstreetmap-tiles-update-expire /usr/bin/
RUN chmod +x /usr/bin/openstreetmap-tiles-update-expire \
&& mkdir /var/log/tiles \
&& chmod a+rw /var/log/tiles \
&& ln -s /home/renderer/src/mod_tile/osmosis-db_replag /usr/bin/osmosis-db_replag \
&& echo "* * * * * renderer openstreetmap-tiles-update-expire\n" >> /etc/crontab
# install trim_osc.py helper script
USER renderer
RUN cd ~/src \
&& git clone https://github.com/zverik/regional \
&& cd regional \
&& git checkout 612fe3e040d8bb70d2ab3b133f3b2cfc6c940520 \
&& chmod u+x ~/src/regional/trim_osc.py
# Start running
USER root
COPY run.sh /
COPY indexes.sql /
ENTRYPOINT ["/run.sh"]
CMD []
EXPOSE 80 5432
这是我的run.sh
文件:
#!/bin/bash
set -x
function CreatePostgressqlConfig()
{
cp /etc/postgresql/10/main/postgresql.custom.conf.tmpl /etc/postgresql/10/main/postgresql.custom.conf
sudo -u postgres echo "autovacuum = $AUTOVACUUM" >> /etc/postgresql/10/main/postgresql.custom.conf
cat /etc/postgresql/10/main/postgresql.custom.conf
}
if [ "$#" -ne 1 ]; then
ls /home/renderer
echo "usage: <import|run>"
echo "commands:"
echo " import: Set up the database and import /data.osm.pbf"
echo " run: Runs Apache and renderd to serve tiles at /tile/{z}/{x}/{y}.png"
echo "environment variables:"
echo " THREADS: defines number of threads used for importing / tile rendering"
echo " UPDATES: consecutive updates (enabled/disabled)"
exit 1
fi
if [ "$1" = "import" ]; then
# Initialize PostgreSQL
CreatePostgressqlConfig
service postgresql start
sudo -u postgres createuser renderer
sudo -u postgres createdb -E UTF8 -O renderer gis
sudo -u postgres psql -d gis -c "CREATE EXTENSION postgis;"
sudo -u postgres psql -d gis -c "CREATE EXTENSION hstore;"
sudo -u postgres psql -d gis -c "ALTER TABLE geometry_columns OWNER TO renderer;"
sudo -u postgres psql -d gis -c "ALTER TABLE spatial_ref_sys OWNER TO renderer;"
# Download Luxembourg as sample if no data is provided
if [ ! -f /data.osm.pbf ]; then
echo "WARNING: No import file at /data.osm.pbf, so importing iran-latest as example..."
wget -nv http://download.geofabrik.de/north-america/canada-latest.osm.pbf -O /data.osm.pbf
# wget -nv http://download.geofabrik.de/europe/luxembourg.poly -O /data.poly
fi
# determine and set osmosis_replication_timestamp (for consecutive updates)
osmium fileinfo /data.osm.pbf > /var/lib/mod_tile/data.osm.pbf.info
osmium fileinfo /data.osm.pbf | grep 'osmosis_replication_timestamp=' | cut -b35-44 > /var/lib/mod_tile/replication_timestamp.txt
REPLICATION_TIMESTAMP=$(cat /var/lib/mod_tile/replication_timestamp.txt)
# initial setup of osmosis workspace (for consecutive updates)
sudo -u renderer openstreetmap-tiles-update-expire $REPLICATION_TIMESTAMP
# copy polygon file if available
if [ -f /data.poly ]; then
sudo -u renderer cp /data.poly /var/lib/mod_tile/data.poly
fi
# Import data
sudo -u renderer osm2pgsql -d gis --create --slim -G --hstore --tag-transform-script /home/renderer/src/openstreetmap-carto/openstreetmap-carto.lua -C 2048 --number-processes ${THREADS:-4} -S /home/renderer/src/openstreetmap-carto/openstreetmap-carto.style /data.osm.pbf
# Create indexes
sudo -u postgres psql -d gis -f indexes.sql
service postgresql stop
exit 0
fi
if [ "$1" = "run" ]; then
# Clean /tmp
rm -rf /tmp/*
# Fix postgres data privileges
chown postgres:postgres /var/lib/postgresql -R
# Initialize PostgreSQL and Apache
CreatePostgressqlConfig
service postgresql start
service apache2 restart
# Configure renderd threads
sed -i -E "s/num_threads=[0-9]+/num_threads=${THREADS:-4}/g" /usr/local/etc/renderd.conf
# start cron job to trigger consecutive updates
if [ "$UPDATES" = "enabled" ]; then
/etc/init.d/cron start
fi
# Run
sudo -u renderer renderd -f -c /usr/local/etc/renderd.conf
service postgresql stop
exit 0
fi
echo "invalid command"
exit 1
#/bin/bash
集合x
函数CreatePostgressqlConfig()
{
cp/etc/postgresql/10/main/postgresql.custom.conf.tmpl/etc/postgresql/10/main/postgresql.custom.conf
sudo-u postgres echo“autovacuum=$autovacuum”>>/etc/postgresql/10/main/postgresql.custom.conf
cat/etc/postgresql/10/main/postgresql.custom.conf
}
如果[“$#”-ne 1];然后
ls/home/renderer
回显“用法:”
回显“命令”:
echo“导入:设置数据库并导入/data.osm.pbf”
echo“run:运行Apache和renderd在/tile/{z}/{x}/{y}.png为tile提供服务”
echo“环境变量:”
echo“线程:定义用于导入/平铺渲染的线程数”
echo“更新:连续更新(启用/禁用)”
出口1
fi
如果[“$1”=“导入”];然后
#初始化PostgreSQL
CreatePostgressqlConfig
postgresql启动服务
sudo-u postgres createuser渲染器
sudo-u postgres createdb-E UTF8-O渲染器
sudo-u postgres psql-dgis-c“创建扩展postgis
sudo-u postgres psql-dgis-c“创建扩展存储
sudo-u postgres psql-dgis-c“将表几何体和列所有者更改为渲染器
sudo-u postgres psql-dgis-c“将表空间参考系统所有者更改为渲染器
#如果未提供任何数据,请下载卢森堡作为示例
如果[!-f/data.osm.pbf];然后
echo“警告:在/data.osm.pbf处没有导入文件,因此导入伊朗是最新的示例…”
wget-nvhttp://download.geofabrik.de/north-america/canada-latest.osm.pbf -O/data.osm.pbf
#wget-nvhttp://download.geofabrik.de/europe/luxembourg.poly -O/data.poly
fi
#确定并设置\u复制\u时间戳(用于连续更新)
osmium fileinfo/data.osm.pbf>/var/lib/mod_tile/data.osm.pbf.info
osmium fileinfo/data.osm.pbf | grep'perosition_replication_timestamp='| cut-b35-44>/var/lib/mod_tile/replication_timestamp.txt
复制\u时间戳=$(cat/var/lib/mod\u tile/REPLICATION\u TIMESTAMP.txt)
#渗透工作区的初始设置(用于连续更新)
sudo-u渲染器openstreetmap tiles更新过期$REPLICATION\u时间戳
#复制多边形文件(如果可用)
如果[-f/data.poly];然后
sudo-u渲染器cp/data.poly/var/lib/mod_tile/data.poly
fi
#导入数据
sudo-u renderer osm2pgsql-dgis--create--slim-G--hstore--tag transform script/home/renderer/src/openstreetmap-carto/openstreetmap-carto/openstreetmap-carto.lua-c2048--number进程${THREADS:-4}-S/home/renderer/src/openstreetmap-carto/openstreetmap-carto.style/data.osm.pbf
#创建索引
sudo-u postgres psql-d gis-f index.sql
服务postgresql停止
出口0
fi
如果[“$1”=“运行”];然后
#清洁/tmp
rm-rf/tmp/*
#修复postgres数据权限
chown postgres:postgres/var/lib/postgresql-R
#初始化PostgreSQL和Apache
CreatePostgressqlConfig
postgresql启动服务
服务apache2重新启动
#配置渲染线程
sed-i-E“s/num_threads=[0-9]+/num_threads=${threads:-4}/g”/usr/local/etc/renderd.conf
#启动cron作业以触发连续更新
如果[“$UPDATES”=“enabled”];然后
/etc/init.d/cron start
fi
#跑
sudo-u渲染器renderd-f-c/usr/local/etc/renderd.conf
服务postgresql停止
出口0
fi
回显“无效命令”
出口1
从映像创建容器时,使用-v
选项装入卷:
docker运行-v openstreetmap数据:/var/lib/postgresql/10/main SampleMap导入
持久数据存储在
openstreetmap data
中。该文件/文件夹不在容器中(每次都创建),而是从主机的文件系统装入的。这就是它持续存在的原因docker volume rm openstreetmap数据
然后重新创建容器如果将PostgreSQL、Apache前端和更新作业拆分为单独的容器,这类问题通常会更容易推理,脚本也会简单得多。