Locked learning resources

Join us and get access to thousands of tutorials and a community of expert Pythonistas.

Unlock This Lesson

Locked learning resources

This lesson is for members only. Join us and get access to thousands of tutorials and a community of expert Pythonistas.

Unlock This Lesson

Registering Plugins With Decorators

In this lesson, you’ll learn how to create a simple plugin architecture using decorators.

00:01 In this last example, I’ll show you how you can register functions using a decorator, sort of like registering plugins. For this final example, I’m going to have you work just inside the REPL. Start by importing random.

00:16 You’ll see why in a moment and how you’re going to use it. Make a dictionary named PLUGINS. Make a decorator. Its name is register().

00:28 It’s going to look very different from the ones that you’ve made up to this point—a little simpler. It will have a docstring saying that it’s designed to """Register a function as a plug-in""".

00:39 Using PLUGINS, take that func that comes in—”Yeah, that funk that comes in”—and using the .__name__ method, add it to functions.

00:52 Then, return the function unchanged. Great. There’s register().

01:00 Now use that as a decorator as you define… These are functions that you created a long time ago. say_hello() takes a name as an argument and returns an f-string, with a very simple f"Hello ", and name as the expression.

01:19 There’s say_hello(). And register this one also. It’s called be_awesome(). It takes a name as an argument and this time returns an f-string with the expression name in it.

01:40 All right. What’s inside PLUGINS now? PLUGINS now has two functions inside of it as the dictionary: say_hello and be_awesome. Pretty cool! Well, how are you going to use it? Next, you’re going to make a function called randomly_greet().

01:59 It takes a name as an argument.

02:05 A greeter and a greeter function—here’s where we’re using random. With the method choice() it’s going to pull out of PLUGINSwe’ll make it into an iterator by using the method .items(). Close off all those parentheses.

02:21 So, random.choice() out of the PLUGINS dictionary to populate greeter and greeter_func. Using print(), make an f-string saying f"Using " which greeter in its repr() version. Close off the print statement. And then return with a call to that greeter() function, with the name that has been passed in. All right!

02:48 I’ll make some space. Now, randomly_greet() is available and let’s say you want to greet "Alice". So here, it’s saying that it’s using the greeter function 'be_awesome', so it randomly picked that one. Try it again. Now it used 'say_hello'.

03:07 Pretty neat! So you could have multiple functions that you’re registering in to create this simplified plugin architecture.

03:17 The main benefit of this simple architecture is that you don’t actually have to maintain a list of which plugins exist. The list gets created every time you register a plugin by applying the decorator to any of those functions, which is pretty neat! Okay.

03:33 It’s time to wrap up Decorators 101 with a final review.

Avatar image for Sam W

Sam W on May 31, 2020

I think I’ve missed something already explained. I wanted to ask about the different form of decorator here. Why does it not have include the inside wrapper function?

And now I’m wondering why we can’t do similar to the above all the time.

e.g.

Why can’t a decorator from before, such as:

def slow_down(func):
    """ Delay for 1 second """
    def wrapper_slow_down_one():
        time.sleep(1)
        return func()
    return wrapper_slow_down_one

not instead just be:

def slow_down(func):
    """ Delay for 1 second """
    time.sleep(1)
    return func
Avatar image for Geir Arne Hjelle

Geir Arne Hjelle RP Team on May 31, 2020

Hi Sam,

the different pattern used here for @register can be used when your decorator only needs to do something when the decorated function is defined, in this case it’s registered to a dictionary.

Since we’re not changing the function that has been passed in, that function will work exactly as if it had not been decorated. In the usual pattern, the decorated function is instead replaced by the inner wrapper function.

If you use your simplified @slow_down decorator, you will notice that the code sleeps for 1 second whenever you define a new decorated function, but it will not sleep when you call that decorated function.

Avatar image for Sam W

Sam W on June 1, 2020

Oh of course. Seems obvious now you say it. Ok, thank you.

Avatar image for levan8421

levan8421 on Sept. 29, 2020

I think there is no need to have return func in the def register(func). Correct me if I am wrong. Thanks

Avatar image for Geir Arne Hjelle

Geir Arne Hjelle RP Team on Sept. 30, 2020

@levan8421 A decorator replaces the function being defined with what’s being returned from the decorator. If you don’t return func, the decorator is implicitly returning None. That would mean that the decorator would replace any function it decorates with None.

For example:

>>> def register(func):
...     print(f"registering {func}")
...
>>> @register
... def hello(name):
...     return f"Hello {name}"
...
registering <function hello at 0x7f432a989200>

>>> print(hello)
None

>>> hello("world")
TypeError: 'NoneType' object is not callable
Avatar image for levan8421

levan8421 on Oct. 6, 2020

Thank you for your response. I understand why decorator needs to return the func in general. I am just talking about this particular example of registering plugins:

import random
PLUGINS = dict()

def register(func):
    PLUGINS[func.__name__] = func

@register
def add(x):
    return x+5

def random_cal(x):
    func_name, func = random.choice(list(PLUGINS.items()))
    print(f'*** Using {func_name}')
    return func(x)

In the decorator **def register(func)**, the func is already added to PLUGINS and that is the sole purpose of this decorator. Later when we call the random_cal, the registered function will be called from the PLUGINS dictionary. That is why I think there would be no need to have *return func* in the def register(func). Of course, I would agree if it is for convention purpose.

Avatar image for Geir Arne Hjelle

Geir Arne Hjelle RP Team on Oct. 6, 2020

@levan8421 True. In that particular example it works without returning the function, because you are only referencing the registered function through the PLUGINS dictionary.

However, it seems bound to cause issues later to have the decorator make the function uncallable directly, so I would still highly recommend returning func - even if your current code doesn’t use it.

Avatar image for Vincent De Haen

Vincent De Haen on Jan. 9, 2021

Great video. LOLed on the “The func that comes in” :D

Avatar image for Bastian

Bastian on Sept. 10, 2021

This example made me understand something I did not grasp at first sight: it looks like the decorator gets executed when we define the decorated function.

(I thought the decorator was executed when we executed the decorated function.)

Avatar image for Geir Arne Hjelle

Geir Arne Hjelle RP Team on Sept. 10, 2021

@Bastian, right. The decorator (meaning the function with the exact same name used behind the @ when decorating) is executed when the decorated function is defined.

In the most typical decorator pattern with the inner function, this decorator then defines a new (inner) wrapper function that is executed when the decorated function is executed. But simple decorators like the one in this video only run on “define-time”.

Avatar image for Bastian

Bastian on Sept. 12, 2021

Ho yes thanks @Geir Arne Hjelle for reminding me that a typical decorator pattern is executed only to define a new wrapper function. This is all so logic and yet feels so counter intuitive to me. I think I get it technically but I still need to get around the concepts and use cases.

Avatar image for Konstantinos

Konstantinos on Sept. 3, 2022

In the last real-world example, the decorated functions become elements of a dictionary and this is described as “registering plugins”. I cannot understand where this applies, thus becoming a real world example.

Avatar image for Geir Arne Hjelle

Geir Arne Hjelle RP Team on Sept. 5, 2022

@Konstantinos Plug-ins gives you an architecture where you can more easily “dynamically” decided which function to call. I use this a lot in my own real world code both for flexibility and because it keeps my code simple.

For a concrete example, pyconfs is my library for working with configurations. It separates “configuration” from “file format” for flexibility. In other words, most of the library doesn’t care or even know whether it’s working with TOML, YAML, or JSON.

This is done by defining readers as plug-ins that are used to load the configuration into memory. If you want to support a new input format, that’s as easy as writing the function that parses that format into memory and decorating that function with @register. You don’t need to change any other part of the code, because the rest of the code only works with the dictionary of registered functions.

The same pattern can be used in many other real world examples. For example, you can register different models to use when calculating satellite orbits, different stages to use in a machine learning model, different windows or tabs to expose in a GUI, and so on.

Another example could pull platform specific code into plug-ins, so that you’d call some code on Windows and another on Linux. Again, this would allow you to add support for new platforms without needing to change the existing code.

I talk a bit more about this principle in this presentation: pyvideo.org/pycon-us-2019/plugins-adding-flexibility-to-your-apps.html

Avatar image for Konstantinos

Konstantinos on Sept. 6, 2022

Thank you @Geir Arne Hjelle for answering that in detail. So, in a high level, I understand that the registered functions should always have the same objective such as “read-file-formats”, “calculate-satellite-orbits”, etc that vary in implementation. It seems like an interesting technique, but needs some practice in my real world situations.

Avatar image for Geir Arne Hjelle

Geir Arne Hjelle RP Team on Sept. 6, 2022

@Konstantinos Yes, exactly. It typically works most efficiently when grouping together functions with the same purpose. Usually you want your registered functions to even share the same signature so that you don’t need “extra knowledge” to call them.

Avatar image for Konstantinos

Konstantinos on Sept. 6, 2022

@Geir Arne Hjelle Thank you very much for your concise and clear explanation.

Become a Member to join the conversation.