News & Blog back

Subscribe

Filters

Autovacuum, explained for engineers, new improved version PGConf.eu 2015 Vienna

Autovacuum, explained for engineers, new improved version PGConf.eu 2015 Vienna from PostgreSQL-Consulting

Lots of things improved, now these slides can be more useful without talk

Comments: 2

2 responses to “Autovacuum, explained for engineers, new improved version PGConf.eu 2015 Vienna”

Alex says:

October 30, 2015 at 2:48 pm

Look, it's an elephant!

Reply
Ove Andersen says:

November 26, 2015 at 7:49 am

Great overview. Another aspect of vacuum is how covering indexes are dependent whether a relallvisible are kept up-to-date (maintained by vacuum). After each ETL or other data processing job we run the following query and vacuums tables which are not up to date. Otherwise our reports suffer massively on covering indexes not being used.

select nspname, relname
from pg_class c
join pg_catalog.pg_namespace n on n.oid = c.relnamespace
where relkind = 'r'
and relallvisible != relpages
order by nspname, relname

Are there any setting that will ensure autovacuum is run, when relallvisible differs from relpages? Will autovacuum_vacuum_threshold =1 do the trick or will that have side effects?

We are very dependent on covering indexes for real-time analysis.

Reply

Leave a Reply Cancel reply

You may also like:

From Backup to Integrity: Leveraging WAL-G for PostgreSQL

A key aspect of maintaining backup integrity is understanding data checksums. Without proper checksum validation, detecting data corruption becomes virtually impossible. Therefore, we will start with The…

Back from PGDay UK 2024

Last Wednesday (September 11, 2024), PGDay UK took place in London. Some of my colleagues live in the area (or not too far away), so it was…

PITR and Streaming Replication environments

Recently, I had to address a support case where a user was struggling to perform Point-in-Time Recovery in his PostgreSQL cluster using streaming replication. We have already…

Handling Cancellation Request

Introduction PgBouncer is a popular connection pooler for PostgreSQL that helps optimize database performance by reducing the number of open connections and improving overall efficiency. It’s widely…

Data Egret’s Marketing team is looking for a Marketing Assistant who will support our marketing efforts and contribute to our company’s growth. This entry-level role would be a perfect fit for someone looking to learn and grow in marketing.

About Data Egret

We are one of the leading consulting firms that provide support and strategic consulting services around the PostgreSQL database.

PostgreSQL was the database of choice among developers, according to the recent Stack Overflow survey, and has received the highest score from DB-Engines for several years, demonstrating a steady and impressive growth in popularity among Relational DBMS.

About you

You are enthusiastic, organised and reliable Marketing Assistant with a positive attitude and passion for marketing and communications and will have the following:

a skill of articulating complex ideas in a clear and accessible manner,
thorough attention to detail,
interest in growing your skills in the niche industry – IT,
a proactive approach: will identify opportunities for improvement and take initiative in solving problems or enhancing processes without needing constant guidance,
excellent analytical skills,
self-motivation: be organised, meet deadlines, and consistently deliver high-quality work with minimal supervision,
very good working level of English (German is a plus).

Location

This is a fully remote, EU/UK based position with occasional travel to Germany and Benelux.

What your day will look like:

You will be a part of the Marketing team and will assist in all aspects of marketing and communication activities at Data Egret. You will:

Assist with the planning and coordination of events and promotional activities (including content design and on-site support),
Develop promotional copy for emails, flyers, and the website,
Design a range of marketing materials based on the provided brief,
Provide day-to-day support to and work closely with the company’s Marketing Director,
Assist in running webinars and social media campaigns,
Assist in Digital Marketing activities (social media management, website content updates, SEO)

Please apply with a covering message, your CV and availability to start.

Have questions about this opportunity?
Contact us! [email protected]

We are one of the leading consulting firms that provide support and strategic consulting services around the PostgreSQL database.

PostgreSQL was the database of choice among developers, according to the recent Stack Overflow survey, and has received the highest score from DB-Engines for several years, demonstrating a steady and impressive growth in popularity among Relational DBMS.

We are seeking a skilled and creative WordPress Designer / Developer to join our growing team.

About you

The ideal candidate will have a strong understanding of both front-end and back-end development, with a keen eye for design and user experience. Reporting to the Marketing Director you will work to support Marketing department in their activities.

Your responsibilities will include:

Maintaining our WordPress websites
Designing and developing new elements and pages for the website as needed for our marketing team

The right candidate will be an enthusiastic team player and have the following skills:

Minimum of 3 years of experience working with WordPress and interest in further developing their skills
Solid understanding of front-end technologies (HTML, CSS, and JavaScript).
Experience of integrating WP with third party systems via API would be a plus
Python and Django knowledge is a plus
Great attention to detail
Knowledge of security & website performance best practices.
Understanding of core web concepts (Domains, DNS, Hosting).
Good communication skills and a willingness to help support other team members.

Self-motivation: you will be organised, meet deadlines, and consistently deliver high-quality work without the need for micromanagement.

This is a full- (40 hours weekly) or part-time (20 hours weekly), remote position with core hours Monday to Friday 09:00-15:00

Please apply with a covering message, your CV and availability to start.

Have questions about this opportunity?
Contact us! [email protected]

At Data Egret we truly love PostgreSQL the only true, community driven, disruptive (in a good way) powerful open-source database technology. PostgreSQL is disrupting the global Database Marketplace, which is projected to reach $154.6 billion by the year 2030.

All the evidence suggest PostgreSQL is going to play a major part of that, it already is!

Data Egret is a consulting firm offering advanced PostgreSQL administration services. We seek a Senior Sales Manager to help us grow our European client base and assist in the organic growth of our current customers.

The Senior Sales Manager will be responsible for all activities and interactions associated with driving revenue growth to expand Data Egret client base in Europe.

This is a full-time remote role; however, it is preferable that you reside in the UK, Germany or Benelux.

Experience required:

10+ years of enterprise IT sales experience, selling to C-level executives.
Exceptional communication skills (verbal and written in German and English, French would be a plus.).
Excellent time management and organisational skills
Experience working with distributed teams from diverse cultural backgrounds.
Excellent time management and organisational skills.

Key responsibilities:

Develop Sales plans and work with Marketing and Operations teams to implement and achieve success in lead generation.
Build strong C-level relationships resulting in growth opportunities within Europe.
Helping our prospects and customers to leverage the power of PostgreSQL through utilisation of Data Egret cutting edge support services.
Meet and exceed sales quota through outbound leads.
Qualify and cultivate leads generated from our website, trade shows and other marketing efforts.

Why choose Data Egret as your place of work?

You will be a part of one of the leading PostgreSQL consultancies and named a significant constributing sponsor to PostgreSQL by the Postgres community.
You will have an opportunity for individual growth and will be able to tackle various aspects of sales cycle while working with dynamic team of colleagues and building upon your network and your experience to grow Data Egret sales.
As our first dedicated Sales Manager in a high growth area your responsibilities are sure to develop further, and you will play an increasing key part for the growth of the business over time.

We offer:

A competitive pay based on your experience and annual performance-based bonus scheme.
Full-remote working.
Flexible working hours.
Collaborative and open working environment where you are supported by your colleagues and can learn and thrive.

Have questions about this opportunity?
Contact us! [email protected]

We don’t want to sound like your mother, but having your databases checked regularly is really important for your application performance.

Our PostgreSQL Service Desk service is performed by DBA with 10+ years PostgreSQL experience who live and breathe Postgres.
They will ensure that your databases have the security and high availability your application needs.

– PHASE 1 –

Audit and Optimisation

This is an induction phase, during which your databases will undergo a thorough review by our DBA, who will:

analyse load tune DB configuration
review your database monitoring data
review and optimise top query
assist in monitoring tool installation
set up auto-healthchecks

During this phase our DBA will be answering any questions regarding:

architecture
database configuration
OS configuration
high availability set up and replication
backup and recovery
upgrades (major and minor)
partitioning
scaling out and sharding practices
access privileges
support during migration to PostgreSQL
consult on hardware selection
locking and concurrency issues

Training

Your developers will also be able to receive an online training session from our experts to ensure they can address key PostgreSQL issues at an industry-standard level. (within your monthly hour limit)

– PHASE 2 –

Ongoing support

Once your databases have been audited and your team trained you will be moved to a subscription-based ongoing support. During this phase our DBA will be around to answer any questions and support in the following:

Questions related to database and OS configuration
Basic query optimisation
Questions that do not require an in-depth investigation
Post factum analysis of database outages (during working hours)
Autohealthcheck reports review (we notify you of any abnormalities)
Monitoring trigger review (we notify you of any abnormalities)

Price: from 10000€/year+VAT (for 2 PostgreSQL instances).

Annual Subscription to PostgreSQL Service Desk is a one-year contract.

Price includes:

up to 10 DBA hours monthly for the duration of Phase 1 (2 months) and
up to 2 DBA hours monthly for Phase 2 (10 months).

Overtime is billed at the end of each month at 250€/hour+VAT rate.

Subject to client’s installation specifications and databases access Phase 1 may take longer and require additional fee. This will be pre-agreed with client in advance.

SLA: Response time is provided as follows:

During Audit and Optimisation (Phase 1) Data Egret provides support with up to 3h response during working hours.
During the Ongoing support (Phase 2) we answer any questions via email with up to 24 hours response time during working hours.

If you are interested in shorter response times we suggest our 24/7 PostgreSQL Support services.

Database Access: Data Egret Service Desk Annual Subscription can be provided with or without access to databases, however without database access addressing any issues will require more time making the process less cost-effective.

Interested in learning more? Give us a nudge via email.

We are a consulting company that offers PostgreSQL administration services. We are looking for a seasoned PostgreSQL DBA specialist for a full-time remote position.

Who will you be working with?

Depending on the client’s team structure you will be working with either client’s DBAs, developers, DevOps, technical managers and CTOs.

Irrespective of client’s team structure you will be surrounded by best in class Data Egret PostgreSQL DBA, who have many years of experience supporting companies that work with PostgreSQL.

What skills will you gain?

In addition to harnessing your technical skills you will grow as a technical support specialist, who is able to listen to our clients, ask questions, review possible solutions with them, and be a reliable partner, who will be a valuable member of the extended client’s team beyond their expectations.

What will your job be like?

You will be the focal point to our clients when it comes to databases – figuring out why things don’t work the way they should, providing guidance and fixes to ensure that our client’s HA projects go like clockwork.

Here are a few examples of your day-to-day technical tasks:

Working with physical/logical replication.
Make changes in schema under load with minimum downtime.
Perform slow query analysis and optimization.
Implementing and troubleshooting backup and recovery practices.
Setting up and configuring Postgres.
Explaining to a customer how to use Postgres in the best way.
Finding and troubleshooting performance issues.
Perform minor and major PostgreSQL upgrades.

What do we expect from you?

You are a seasoned DBA with 2 or more years of experience in the management of high-availability clusters.
PostgreSQL projects (including replication configuration, performance tuning, monitoring configuration etc.).
Have experience in optimizing complex SQL queries.
Enjoy working independently and leading an open dialog with clients in order to obtain the necessary information regarding client’s problems, identify the issue, offer and discuss with client possible solutions and communicate upon delivery.
You are a confident Linux user and know how to perform basic system administration (Ubuntu/Debian/RedHat).
Have general understanding of database theory.
Have basic knowledge of shell scripting (writing screens-lengthy scripts that will be understandable to other admins and to yourself a few months later).
You can write and especially read complex (and very complex) SQL queries.
You are a keen learner and eager to discover new solutions to old problems.

Important: This is a client facing role and the ability to communicate your actions and be able to reason with client is imperative.

What skills would be a plus?

Working knowledge of German would be a plus.
Familiarity with Patroni.
Experience with PostgreSQL in cloud (AWS, RDS etc.)
Familiarity with some DevOps tools such as Ansible/Docker/Kubernetes.
Experience performing recovery from a backup.
C programming skills and experience in analysing with perf/strace/gdb.
Administration experience with cloud platforms.
Interest in giving conference talks and/or writing technical blog posts.
Experience working with PgBouncer.
Experience working with Postgres source code.
You performed or supported through migrations to Postgres from other DBMS.
You know how to work with monitoring solutions (DataDog, Odarix, NewRelic, Zabbix, pgwatch2 or other services/tools), as well as working with PostgreSQL logs gathering and interpreting data.

Why choose Data Egret as your place of work?

You will be a part of one of the leading PostgreSQL DBA teams working in a consultancy that has been named a significant sponsor to PostgreSQL by the Postgres community.
You will be able to brush up your database administration skills on a multitude of databases in different environments and gain experience that would normally take you years to get working in-house within months.

We offer:

A competitive pay based on your experience and annual performance-based bonus scheme.
Full-remote working.
Flexible working hours.
An opportunity to work alongside DBA colleagues, who live and breathe Postgres and contribute to its development.
Support of your participation in conferences and other PostgreSQL community-related work.
Collaborative and open environment where you are supported by your colleagues and can learn and thrive.

Have questions about this opportunity?
Contact us! [email protected]

Health Check

Most emergencies leading to service unavailability and loss of your data can be mitigated and detected at an early stage with minimal effort. Data Egret Health Check will ensure a smooth running of your service, give you a headstart for your launch or migration and will allow better budgetary planning.

We will provide you a tailored offering based on your system specifications, however, below rates will give you an idea of pricing for our Health Check solution.

Package	Price*
PostgreSQL configuration analysis	from 500 €
Hardware and OS configuration analysis	from 600 €
Slow SQL queries analysis	from 500 €
Comprehensive performance Health Check*	from 3500 €
* For single PostgreSQL installation (1 master + 1 replica)

24/7 PostgreSQL Support

24/7 PostgreSQL Support offers you a combination of ongoing consultancy from our experts as well as round the clock support from dedicated team. To ensure smooth running of your systems and give you peace of mind we will be providing following services:

Dedicated Data Egret team

that will be your contact in case of any questions or concerns. Team that will be aware of your system’s specifications and will work on any arising issues within 15 minutes to an hour from enquiry.

Real time counsel

on everything PostgreSQL provided by our team of experts to your company developers and operations engineers.

Ongoing monitoring of your databases

that includes query performance, issues management and recommendation on performance improvements.

Regular upgrades

of PostgreSQL and related software.

Backup and recovery

that includes regular backup of your database and recovery solution with regular test recovery.

Basic	Premium	VIP
Incl. up to 5h/month DBA time	Incl. up to 15h/month DBA time	Incl. up to 30h/month DBA time
Slack, Mattermost, Telegram	Slack, Mattermost, Telegram	Slack, Mattermost, Telegram
Response time — 1 Hour	Response time — 1 Hour	Response time — 30 minutes
Up to 2 PostgreSQL instances	Up to 5 PostgreSQL instances	Up to 10 PostgreSQL instances