{"id":5205,"date":"2020-04-28T10:20:05","date_gmt":"2020-04-28T10:20:05","guid":{"rendered":"https:\/\/www.askpython.com\/?p=5205"},"modified":"2023-02-16T19:57:06","modified_gmt":"2023-02-16T19:57:06","slug":"python-system-command","status":"publish","type":"post","link":"https:\/\/www.askpython.com\/python-modules\/python-system-command","title":{"rendered":"Python System Command: How to Execute Shell Commands in Python?"},"content":{"rendered":"\n

Introduction<\/h2>\n\n\n\n

Today in this tutorial, we are going to discuss how we can execute shell commands using Python system command<\/strong>.<\/p>\n\n\n\n

So let’s get started with some basics of Python system command.<\/p>\n\n\n\n

What is Python System Command?<\/h2>\n\n\n\n

We may need to integrate features for carrying out some system administration tasks in Python. These include finding files, running some shell commands, doing some advanced file handling, etc. And to do so, we need some way to interface between the system and the python interpreter. <\/p>\n\n\n\n

Executing command lines<\/strong> using Python can be easily done using some system methods from the os module<\/code>. <\/p>\n\n\n\n

But with the introduction of the subprocess<\/code> module(intending to replace some older modules), accessing command line has been a lot more easier to use. As well as to manipulate the output and avoid some limitations of the traditional methods.<\/p>\n\n\n\n

Executing Shell Commands in Python<\/h2>\n\n\n\n

Now that we got to know about the System Commands in Python. Let us take a look into how we can implement the same.<\/p>\n\n\n\n

1. Using os.system() Method<\/h2>\n\n\n\n

As stated earlier, executing shell commands in Python can be easily done using some methods of the os<\/code> module. Here, we are going to use the widely used os.system()<\/code> method. <\/p>\n\n\n\n

This function is implemented using the C<\/strong> system()<\/code> function, and hence has the same limitations.<\/p>\n\n\n\n

The method takes the system command as string in input and returns the exit code<\/strong> back.<\/p>\n\n\n\n

In the example below, we try to check our system Python version<\/strong> using command line in Python.<\/p>\n\n\n

\nimport os\n\ncommand = "python --version" #command to be executed\n\nres = os.system(command)\n#the method returns the exit status\n\nprint("Returned Value: ", res)\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n
\nPython 3.7.4\nReturned Value:  0\n<\/pre><\/div>\n\n\n
Here, res<\/code> stores the returned value (exit code=0<\/strong> for success). It is clear from the output, that the command is executed successfully and we get our Python version as expected.<\/p>\n\n\n\n
2. Using the subprocess Module<\/h2>\n\n\n\n
The subprocess<\/code> module comes with various useful methods or functions to spawn new processes, connect to their input\/output\/error pipes, and obtain their return codes. <\/p>\n\n\n\n
In this tutorial, we are considering the call()<\/code> and check_output()<\/code> methods as they are easy to use<\/strong> and reliable<\/strong>. But for more info you can always refer to the official documentation<\/a>.<\/p>\n\n\n\n
2.1. The call() Method<\/h3>\n\n\n\n
Now getting to the subprocess.call()<\/code> method.<\/p>\n\n\n\n
The call()<\/code> method takes in command line arguments passed as a list of strings or with the shell<\/strong> argument set to True<\/code>. And returns back us the exit code<\/strong> or status<\/strong>.<\/p>\n\n\n\n
In the below code snippet, we try to install pandas<\/a> using PIP<\/strong> from shell<\/strong>.<\/p>\n\n\n
\nimport subprocess\n\ncommand = "pip install pandas" #command to be executed\n\nres = subprocess.call(command, shell = True)\n#the method returns the exit code\n\nprint("Returned Value: ", res)\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n
\nCollecting pandas\n  Downloading pandas-1.0.3-cp37-cp37m-win32.whl (7.5 MB)\nRequirement already satisfied: pytz>=2017.2 in c:\\users\\sneha\\appdata\\local\\programs\\python\\python37-32\\lib\\site-packages (from pandas) (2019.3)\nRequirement already satisfied: numpy>=1.13.3 in c:\\users\\sneha\\appdata\\local\\programs\\python\\python37-32\\lib\\site-packages (from pandas) (1.18.1)\nRequirement already satisfied: python-dateutil>=2.6.1 in c:\\users\\sneha\\appdata\\local\\programs\\python\\python37-32\\lib\\site-packages (from pandas) (2.8.1)\nRequirement already satisfied: six>=1.5 in c:\\users\\sneha\\appdata\\local\\programs\\python\\python37-32\\lib\\site-packages (from python-dateutil>=2.6.1->pandas) (1.14.0)\nInstalling collected packages: pandas\nSuccessfully installed pandas-1.0.3\nReturned Value:  0\n<\/pre><\/div>\n\n\n
As we can see, the command is executed successfully with return value zero<\/code>.<\/p>\n\n\n\n
2.2. The check_output() Method<\/h3>\n\n\n\n
The above mentioned methods execute the shell command passed successfully but don’t give the user the freedom to manipulate the way we get the output. For doing that, the subprocess’s<\/strong> check_output()<\/code> method has to come into the picture.<\/p>\n\n\n\n
The method executes the passed command<\/strong> but instead of returning the exit status, this time it returns a bytes<\/code> object. <\/p>\n\n\n\n
Take a closer look at the example below where we try to install the pymysql<\/code> module again(already installed).<\/p>\n\n\n
\nimport subprocess\n\ncommand = "pip install pymysql" #command to be executed\n\nres = subprocess.check_output(command) #system command\n\nprint("Return type: ", type(res)) #type of the value returned\n\nprint("Decoded string: ", res.decode("utf-8")) #decoded result\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n
\nReturn type:  <class 'bytes'>\nDecoded string:  Requirement already satisfied: pymysql in c:\\users\\sneha\\appdata\\local\\programs\\python\\python37-32\\lib\\site-packages (0.9.3)\n<\/pre><\/div>\n\n\n
Here similar to the previous cases, res<\/code> holds the returned object by the check_output()<\/code> method. We can see type(res)<\/code> confirms that the object is of bytes<\/code> type. <\/p>\n\n\n\n
After that, we print the decoded<\/strong> string and see that the command was successfully executed.<\/p>\n\n\n\n
Conclusion<\/h2>\n\n\n\n
So, today we learned how we can execute system commands using Python system command (os.system()) and the subprocess module.<\/strong> We have considered some more python related commands here, but it is worth noting that the methods are not limited to these. <\/p>\n\n\n\n
We recommend trying out other commands using the above methods on your own to get a better understanding.<\/p>\n\n\n\n
For any further questions, feel free to comment below.<\/p>\n\n\n\n
References<\/h2>\n\n\n\n