Working With JSON Data

I still don’t understand the what the difference is between serialized and deserialized means. Is it just that when deserializing we are pulling the matching the data to the key pairs when we read the json file? I’m missing somthing.

Serializing - Converting Python’s List data format into JSON data . So you are encoding the python data into JSON data format (object format or string format)

Deserializing : Just doing the opposite ie decoding the JSON data back to Python data format .

Pulling the data from a Web API will give JSON formatted data which has to be converted (decoded) to Python data and based on whether you need the enitire data or not you apply relevant Python techniques to filter your final data.

What is the process for importing data from Json file into python?

Todos isn’t working in Jupyter Notebook and Python IDE 3.7 but it’s working in Spyder IDE. Can you tell me please, how it will work in Jupyter Notebok?

Its hard to understand, you could have taken aws as an example, it will be easier to understand.

How did you get the output screen on the right? what is that part in vs code is it an extension ?

So when I go to print the filtered object before converting it it just returns the object at some memory location, not the actual filtered object. so it seems in order to view it, you actually have to convert it to some type of containter, am I correct?

Very difficult to follow what is being explained. It would be worth giving an overview of what we are trying to achieve and how before any code is written

For the keep function, why use the “and” for the return values instead of the “,”. I tried the return iscomplete, has_max_count, but it seems doesn’t filter anything

@yaost The built-in filter() function expects a predicate that returns either True or False. When you replace the and keyword with a comma, then your keep() function will return a tuple instead. A non-empty tuple, which has two elements in this case, will always evaluate to True, keeping all elements or not filtering anything as you observed.

Hi everyone, here are a couple of notes on the comments. @rajss2494 and @maniviswa, sorry you found this lesson hard to follow, and thanks for the suggestions! Maybe I can help to clear up some of the confusing bits:

Importing JSON from a File

@ravipgupta12 you can do this also with the json module, similar to how Austin shows in the video, only you’ll have to open a file object first:

import json

with open("your-json-file.json", "r") as f_in:
    data = json.load(f_in)

Note that you’ll have to use the json.load() function (rather than json.loads()) if you’re reading from a file object.

Todo’s not working

@Ranit Pradhan I don’t quite understand your question. Are you looking for a way to apply syntax highlighting to the word “TODO” in a Jupyter Notebook?

Right-Hand VSCode Panel

@J the panel you can see on the right is the Output panel that comes built-in with VSCode. It might be at the bottom for you, Austin just moved it to the right.

Also the Debugger that he uses for a moment already comes with VSCode, so you won’t have to install any extensions to do what Austin does in this lesson.

The filter() Function

@J the filter() function returns a filter object that yields values on demand. So you can either call the next() function on it to get the next item, iterate over it, or—like you said—convert it to a collection, e.g. a list, if you want to read all of the values it yields. You can check out Python’s filter(): Extract Values From Iterables for more information on this function.

String Output

@yaost the " and " string that Austin uses for the output is just one possible example of how to format it. It doesn’t have any specific meaning, and you could have used a comma (,) instead just as well.

I re-coded “Working with JSON Data in Python” to use several features I learnt last week. The goal I have is to use python features to make the code more concise and easier to code. Feel free to comment and offer suggestions that will help me better understand python. (FYI… I did not put in any error checking in the code) Thanks for your feedback.

import json
import requests
from collections import Counter

response = requests.get("https://jsonplaceholder.typicode.com/todos")
todos = json.loads(response.text)

completed_users = list([_["userId"]  for _ in todos if _["completed"]])     # filter out completed users
completed_users_counter =  Counter(completed_users)                         # use counter to get totals of complete users
max_completed = completed_users_counter.most_common()[0][1]                 #  Maximum completed items

max_users = list([_[0] for _ in completed_users_counter.items()  if _[1] == max_completed ]) 
                                                                            # completed_users_counter.items() returns [(5, 12), (10, 12)]
                                                                            # returns [5, 10]
max_users_print = ' and '.join("{0}". format(n) for n in max_users)   
print(f"user(s) {max_users_print} completed {max_completed} TODOs")

with open("filtered_data_file.json","w") as data_file:
    max_users_completed_todos = [_ for _ in  todos if _["userId"] in max_users and _["completed"]  ]
    json.dump(max_users_completed_todos,data_file,indent=4)

This was awesome Guys! I learnt a lot from it. These lines were absolute highlights for me:

sorted_users = sorted(todos_by_user.items(), key=lambda x: x[1], reverse=True)
filtered_todos = list(filter(keep, todos))

As a beginner understanding this was a bit difficult with the implementation of lambda functions and explaining the main purpose of the code instead of why we do each step of the overall for loops.

I found error while importing requests module

File “d:\pythonProject\WorkingWithJSONAndPython\jsonplace.py”, line 2, in <module> import requests ModuleNotFoundError: No module named ‘requests’