Shell 将大文件从驱动器下载到colab

Shell 将大文件从驱动器下载到colab,shell,google-drive-api,google-colaboratory,Shell,Google Drive Api,Google Colaboratory,我有一个指向公共Google Drive托管文件的链接: 下面是一个适用于不同文件和链接的.sh脚本: #!/usr/bin/env bash function gdrive_download () { # credit to https://github.com/ethanjperez/convince CONFIRM=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-cert

我有一个指向公共Google Drive托管文件的链接:

下面是一个适用于不同文件和链接的.sh脚本:

#!/usr/bin/env bash
function gdrive_download () { # credit to https://github.com/ethanjperez/convince
  CONFIRM=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate "https://docs.google.com/uc?export=download&id=$1" -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')
  wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$CONFIRM&id=$1" -O $2
  rm -rf /tmp/cookies.txt
}

mkdir -p Models/real-fixed-cam Models/real-hand-held
gdrive_download 1yiNsSkPYoBZ55fSQ1iwb1io9QL_PcR2i Models/real-fixed-cam/netG_epoch_12.pth
gdrive_download 13HckO9fPAKYocdB_CAC5n8uyM3xQ2MpG Models/real-hand-held/netG_epoch_12.pth
在Colab中调用上述脚本时使用以下命令:

!wget https://gist.githubusercontent.com/andreyryabtsev/458f7450c630952d1e75e195f94845a0/raw/0b4336ac2a2140ac2313f9966316467e8cd3002a/download.sh
!chmod +x download.sh
!./download.sh
我对其进行了如下调整,以满足我的需要:

#!/usr/bin/env bash
function gdrive_download () { # credit to https://github.com/ethanjperez/convince
  CONFIRM=$(wget --quiet --save-cookies /tmp/cookies.txt --keep-session-cookies --no-check-certificate "https://docs.google.com/uc?export=download&id=$1" -O- | sed -rn 's/.*confirm=([0-9A-Za-z_]+).*/\1\n/p')
  wget --load-cookies /tmp/cookies.txt "https://docs.google.com/uc?export=download&confirm=$CONFIRM&id=$1" -O $2
  rm -rf /tmp/cookies.txt
}

mkdir -p pix2pix/checkpoint
gdrive_download 19VsarMcYRNPLTDr6b6ABJyY8JUeBueL8 pix2pix/checkpoint/weights.zip
在colab中调用上述代码时使用:

!wget https://gist.githubusercontent.com/Daryl149/070397c9cb3539f5cd01173f6c44200d/raw/207a76e94e70e6c9334f48c25b4998f4fd1b95e3/download.sh
!chmod +x download.sh
!./download.sh
文件夹已正确创建。但它并没有将500mb+zip文件下载到checkpoints文件夹,而是从下载确认页面下载html。 在日志记录中,脚本似乎每次都会接收到一个新的下载确认字符串,该字符串通常会在不进行病毒扫描的情况下强制谷歌硬盘下载:

--2020-07-27 21:55:21--  https://drive.google.com/uc?export=download&confirm=umyj&id=19VsarMcYRNPLTDr6b6ABJyY8JUeBueL8
Resolving drive.google.com (drive.google.com)... 74.125.142.138, 74.125.142.101, 74.125.142.100, ...
Connecting to drive.google.com (drive.google.com)|74.125.142.138|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ‘pix2pix/checkpoint/weights.zip’
试试这个

!gdown --id 19VsarMcYRNPLTDr6b6ABJyY8JUeBueL8
然后,您可以使用创建一个新目录!mkdir或将weights.zip移到那里。

试试这个

!gdown --id 19VsarMcYRNPLTDr6b6ABJyY8JUeBueL8

然后,您可以使用创建一个新目录!mkdir或将weights.zip移到那里。

根据@korakot的回答,在Colab中实现结果的完整工作代码是:

!gdown https://drive.google.com/uc?id=19VsarMcYRNPLTDr6b6ABJyY8JUeBueL8
!mkdir /content/Person_remover/pix2pix/checkpoint
import shutil
shutil.move("/content/Person_remover/weights.zip", "/content/Person_remover/pix2pix/checkpoint")

根据@korakot的回答,在Colab中实现结果的完整工作代码为:

!gdown https://drive.google.com/uc?id=19VsarMcYRNPLTDr6b6ABJyY8JUeBueL8
!mkdir /content/Person_remover/pix2pix/checkpoint
import shutil
shutil.move("/content/Person_remover/weights.zip", "/content/Person_remover/pix2pix/checkpoint")

可能需要!mkdir-pIt按原样工作,因为我的默认项目中已经存在/content/Person_remover/pix2pix。但它可能更干净,包括-p无论如何?可能需要!mkdir-pIt按原样工作,因为我的默认项目中已经存在/content/Person_remover/pix2pix。但它可能更干净,包括-p无论如何?