Monday 15 May 2017

Job scheduler for PostgreSQL "pg_cron"

I am trying to highlight cron job facility inside the databases as per my knowledge .
Today i am going explore pg_cron ,So let's start .  
What is pg_cron  : - 
pg_cron is a simple cron-based job scheduler for PostgreSQL (9.5 or higher) that runs inside the database as an extension. It uses the same syntax as regular cron, but it allows you to schedule PostgreSQL commands directly from the database .
Let's see how it's works 

Step 1 :- 


For implementing/Installation of pg_cron you need to download source code from git


export PATH=/usr/local/pgsql/bin:$PATH
wget https://github.com/citusdata/pg_cron/archive/master.zip
unzip master
cd pg_cron-master/
make
make install
  

Step 2 : -

To start the pg_cron background worker when PostgreSQL starts, you need to add pg_cron to shared_preload_libraries in postgresql.conf and restart PostgreSQL

Note that pg_cron does not run any jobs as a long a server is in hot standby mode, but it automatically starts when the server is promoted.

Add below line in postgresql.conf
shared_preload_libraries = 'pg_cron'


Step 3 : -

Create extension pg_cron ,After creation of extension it will create one schema having one table "job"


create extension pg_cron ;



Step 4 : - 

Now try to setup your job inside the DB .

A) 

-- Vacuum Analyze every day at 11:00am
SELECT cron.schedule('0 11 * * *', 'VACUUM ANALYZE');


B) To run SQL statement in scheduler.


-- Delete old data on Saturday at 3:30
SELECT cron.schedule('30 3 * * 6', $$DELETE FROM events WHERE event_time < now() - interval '1 week'$$);



C) Stop/unscheduled job




The schedule uses the standard cron syntax, in which * means "run every time period", and a specific number means "but only at this time":
 ┌───────────── min (0 - 59)
 │ ┌────────────── hour (0 - 23)
 │ │ ┌─────────────── day of month (1 - 31)
 │ │ │ ┌──────────────── month (1 - 12)
 │ │ │ │ ┌───────────────── day of week (0 - 6) (0 to 6 are Sunday to
 │ │ │ │ │                  Saturday, or use names; 7 is also Sunday)
 │ │ │ │ │
 │ │ │ │ │
 * * * * * 
How to run SQL job against remote server :-



If you are superuser, then you can manually modify the cron.job table and use custom values for nodename and nodeport to connect to a different machine:

INSERT INTO cron.job (schedule, command, nodename, nodeport, database, username)
VALUES ('0 11 * * *', 'VACUUM ANALYZE', 'postgresql-pgcron', 5432, 'postgres', 'tushar');

You can use .pgpass to allow pg_cron to authenticate with the remote server .  


Background process : - 

Process "bgworker: pg_cron_scheduler" get executed in back-end to run scheduled  jobs .

Please refer below snip .




14 comments:

  1. Hello Tush,

    It's good to run day to day cron jobs from database, But is there any way to run shell scripts from pg_cron?

    ReplyDelete
    Replies
    1. Hello ,

      As of now there is no features available to to run shell script from pg_cron .

      Thanks
      Tushar

      Delete
  2. Hi Tushar,
    can pg_cron run every second?

    ReplyDelete
  3. This comment has been removed by the author.

    ReplyDelete
  4. Hello, where can I find logs of pg_cron, I mean, if job has failed, where can I see what happened and when?

    ReplyDelete
  5. You can check this into postgresql pg_log .That which command you are running inside pg_cron this will get reflected into DB log .

    ReplyDelete
  6. hi can u send me the pg_cron link

    ReplyDelete
    Replies
    1. Which link you want ?

      This is my blog link [pg_cron] - > http://tushar-postgresql.blogspot.in/2017/05/job-scheduler-for-postgresql-pgcron.html

      Delete
  7. Hi, I have installed pg_cron using the same process.But, my cron is not executing. What could be the issue.

    ReplyDelete
  8. Hi, is possible install pg_cron in windows OS?

    ReplyDelete
  9. I got here much interesting stuff. The post is great! Thanks for sharing it! Capacity Planning Importance

    ReplyDelete
  10. try https://github.com/RekGRpth/pg_task

    ReplyDelete