4 ways to copy files from one server to another in Python

In Python, copying files from one server to another often involves network transfer.

This process can be achieved in many ways, here are 4 commonly used methods.

1. Use the scp command

scp is a file copy tool based on the SSH protocol, which you can call in Python using the subprocess module. This approach requires that SSH connections be established between two servers.

import subprocess

# Define the source file path and the destination pathsource_file = '/path/to/source/'
destination_file = 'user@destination_server:/path/to/destination/'

# Build scp commandscp_command = f'scp {source_file} {destination_file}'

# Call the scp commandresult = (scp_command, shell=True)

# Check the command execution resultsif  == 0:
    print('File transfer successful')
else:
    print('File transfer failed')

2. Use the paramiko library

paramiko is a Python-implemented SSHv2 protocol library that can be used to execute SSH commands, upload and download files.

import paramiko

# Set SSH connection parametershostname = 'destination_server'
port = 22
username = 'user'
password = 'password'
source_file = '/path/to/source/'
destination_file = '/path/to/destination/'

# Create an SSH clientclient = ()
client.set_missing_host_key_policy(())
(hostname, port, username, password)

# Create an SFTP clientsftp = client.open_sftp()
(source_file, destination_file)

# Close the connection()
()

print('File transfer successful')

3. Use the rsync command

rsync is a fast and versatile file copying tool. It can synchronize files between servers via the SSH protocol.

import subprocess

# Define the source file path and the destination pathsource_file = '/path/to/source/'
destination_file = 'user@destination_server:/path/to/destination/'

# Build rsync commandrsync_command = f'rsync -avz {source_file} {destination_file}'

# Call rsync commandresult = (rsync_command, shell=True)

# Check the command execution resultsif  == 0:
    print('File transfer successful')
else:
    print('File transfer failed')

4. Use the FTP/SFTP client library

If your server supports FTP or SFTP, you can use Python libraries such as ftplib or pysftp to upload and download files.

from pysftp import Connection

# Set FTP/SFTP connection parametershostname = 'destination_server'
username = 'user'
password = 'password'
remote_path = '/path/to/destination/'
local_path = '/path/to/source/'

# Establish an SFTP connectionwith Connection(hostname, username=username, password=password) as sftp:
    (local_path, remote_path)

print('File transfer successful')

5. Things to note

Make sure you have sufficient permissions to read files on the source server and write files on the target server before file transfer.

Protect your credentials, do not hardcode passwords in your code, and use environment variables or configuration files to manage sensitive information.

With network security in mind, ensure that encrypted transmission methods such as SSH or SFTP are used.

Depending on your network environment and server configuration, you may need to install the corresponding software package or library.

This is the article about 4 ways to copy files from one server to another in Python. For more related Python file copying content, please search for my previous articles or continue browsing the following related articles. I hope everyone will support me in the future!