tag:status.ipaper.io,2005:/historyiPaper Status - Incident History2024-03-28T16:47:04+01:00iPapertag:status.ipaper.io,2005:Incident/198675672024-01-30T10:30:00+01:002024-01-30T16:11:02+01:00Issue tracking secondary metrics<p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>10:30</var> CET</small><br><strong>Resolved</strong> - Our secondary event tracking was experiencing issues related to an increase in traffic.<br />As such the following events could not be tracked between 10:30 and 15:30<br /><br />* Archive opened<br />* Build a Flipbook opened<br />* Search opened<br />* Basket opened<br />* Item added to basket<br />* Share opened<br /><br />It is important to note that sessions, pageviews, time spent, and checkouts were not impacted by this issue.</p>tag:status.ipaper.io,2005:Incident/193315142023-12-11T14:47:26+01:002023-12-11T14:47:26+01:00Login is failing on certain Partners<p><small>Dec <var data-var='date'>11</var>, <var data-var='time'>14:47</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>09:23</var> CET</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>12:31</var> CET</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>11:58</var> CET</small><br><strong>Investigating</strong> - We are currently seeing failures to login on certain Partners.<br />We are currently investigating this issue.</p>tag:status.ipaper.io,2005:Incident/193311982023-12-06T12:58:51+01:002023-12-06T12:58:51+01:00Unable to login to our Organizations admin<p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>12:58</var> CET</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>09:00</var> CET</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Dec <var data-var='date'> 6</var>, <var data-var='time'>09:00</var> CET</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>11:33</var> CET</small><br><strong>Identified</strong> - The issue has been identified and a fix has been implemented but we are unable to get it live because of a third-party issue. We are in contact with them and hope to get it resolved soon.</p>tag:status.ipaper.io,2005:Incident/192425412023-12-04T16:04:49+01:002023-12-04T16:04:49+01:00Unable to process new SSL certificates<p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>16:04</var> CET</small><br><strong>Resolved</strong> - We have resolved issues with checking CAA for branded domains, and are back to creating issues as normal again.<br />We appreciate your patience and have added several measures to better prevent this in the future.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>15:33</var> CET</small><br><strong>Investigating</strong> - We are currently experiencing a challenge processing new SSL certificates.<br />We are working with our provider to resolve this as quickly as possible.<br /><br />Existing certificates are unaffected, and are valid until February 12, 2024.</p>tag:status.ipaper.io,2005:Incident/186749662023-10-03T12:12:05+02:002023-10-03T12:12:05+02:00We are experiencing issues with our Admin<p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>12:12</var> CEST</small><br><strong>Resolved</strong> - The issue has now been resolved.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>09:30</var> CEST</small><br><strong>Monitoring</strong> - A fix has been implementing and we will be monitoring the results.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>09:22</var> CEST</small><br><strong>Investigating</strong> - We are currently investigating what is wrong</p>tag:status.ipaper.io,2005:Incident/186194232023-09-27T11:13:58+02:002023-09-27T11:13:58+02:00Display is not loading as intended<p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>11:13</var> CEST</small><br><strong>Resolved</strong> - The issue has been resolved.</p><p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>10:35</var> CEST</small><br><strong>Monitoring</strong> - We have managed to fix the issue and now monitoring</p><p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>10:10</var> CEST</small><br><strong>Investigating</strong> - We are currently investigating</p>tag:status.ipaper.io,2005:Incident/181619462023-08-16T15:07:16+02:002023-08-16T15:07:16+02:00Intermittent flipbook load failures<p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>15:07</var> CEST</small><br><strong>Resolved</strong> - We have found no further issues and will mark the incident as resolved</p><p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>14:06</var> CEST</small><br><strong>Monitoring</strong> - We experienced intermittent issues with our app servers, we have deployed a fix and now monitoring the results</p><p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>13:44</var> CEST</small><br><strong>Investigating</strong> - We are currently seeing intermittent load issues of flipbooks<br /><br />Our team is investigating and hope to have full functionality restored as soon as possible.<br /><br />We will keep you updated as we progress.</p>tag:status.ipaper.io,2005:Incident/171300412023-05-15T10:15:49+02:002023-05-15T10:15:49+02:00Sporadic issues with processing a flipbook<p><small>May <var data-var='date'>15</var>, <var data-var='time'>10:15</var> CEST</small><br><strong>Resolved</strong> - The issue has now been fixed.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>08:29</var> CEST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>May <var data-var='date'> 3</var>, <var data-var='time'>11:27</var> CEST</small><br><strong>Investigating</strong> - We are currently seeing sporadic issues with processing a flipbook<br /><br />Our team is investigating and hope to have full functionality restored as soon as possible.</p>tag:status.ipaper.io,2005:Incident/171296712023-05-15T10:15:39+02:002023-05-15T10:15:39+02:00Sporadic issues with saving in Enrichment Editor<p><small>May <var data-var='date'>15</var>, <var data-var='time'>10:15</var> CEST</small><br><strong>Resolved</strong> - The issue has now been fixed.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>08:30</var> CEST</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>May <var data-var='date'> 4</var>, <var data-var='time'>08:30</var> CEST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>May <var data-var='date'> 3</var>, <var data-var='time'>10:37</var> CEST</small><br><strong>Investigating</strong> - We are currently seeing sporadic issues with saving in our Enrichment Editor<br /><br />Our team is investigating and hope to have full functionality restored as soon as possible.</p>tag:status.ipaper.io,2005:Incident/167409612023-04-04T16:31:55+02:002023-04-05T11:39:02+02:00Select accounts are experiencing inflated page views and time spent statistics.<p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>16:31</var> CEST</small><br><strong>Resolved</strong> - The rollback has adjusted statistical tracking to its previous baseline, without further inflated page views.<br />While we consider this challenge resolved, there is some aftermath, as some customers have had their statistical data affected during this period.<br /><br />Stay tuned for a full Post Mortem, with additional information.</p><p><small>Apr <var data-var='date'> 4</var>, <var data-var='time'>01:44</var> CEST</small><br><strong>Monitoring</strong> - We have performed a rollback on a set of changes made to our statistics tracking on March 21st.<br />We will continue to monitor and investigate the extent of customers impacted by this incident.</p><p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>22:21</var> CEST</small><br><strong>Investigating</strong> - We are currently investigating the extent of the challenge.<br />This Incident will be continuously updated during the investigation.</p>tag:status.ipaper.io,2005:Incident/167353712023-04-03T11:50:34+02:002023-04-03T16:35:51+02:00Double registration of products added to basket<p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>11:50</var> CEST</small><br><strong>Resolved</strong> - We noticed discrepancies in our statistics tracking for products added to basket</p>tag:status.ipaper.io,2005:Incident/167353562023-04-03T11:48:26+02:002023-04-03T11:53:47+02:00No tracking of heatmap hotspots<p><small>Apr <var data-var='date'> 3</var>, <var data-var='time'>11:48</var> CEST</small><br><strong>Resolved</strong> - We noticed that our statistics tracking for point clicks was not working properly, which affects our heatmap hotspots</p>tag:status.ipaper.io,2005:Incident/166901922023-03-30T08:42:53+02:002023-03-30T08:42:53+02:00Experiencing slow requests on Flipbooks<p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>08:42</var> CEST</small><br><strong>Resolved</strong> - There has been no more slowdowns, resolving this issue.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>00:05</var> CEST</small><br><strong>Monitoring</strong> - A fix has been deployed, and we are seeing latency going down and flipbooks returning to normal loading speeds.<br />Will continue to monitor before resolving this incident.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>23:14</var> CEST</small><br><strong>Identified</strong> - We have identified the cause of these slowdowns to being a misconfiguration with our Redis cluster, we are working on a solution.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>21:05</var> CEST</small><br><strong>Investigating</strong> - We are currently seeing high latency from our load balancer affecting Flipbooks load times, we are investigating the cause of this.</p>tag:status.ipaper.io,2005:Incident/166790192023-03-28T23:18:13+02:002023-03-28T23:18:13+02:00Slow flipbook response time<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>23:18</var> CEST</small><br><strong>Resolved</strong> - Resolving this, as no further slowdown has been detected.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>22:15</var> CEST</small><br><strong>Monitoring</strong> - The systems are working at normal capacity again, we are still investigating the root cause of the high Load Balancer Latency we were seeing, but all applications were running normally, it is likely our cloud provider were experiencing issues.<br />We will continue to monitor the situation before resolving this incident.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>20:31</var> CEST</small><br><strong>Investigating</strong> - We are currently seeing that our flipbooks has a slow response time.<br /><br />Our team is investigating and hope to have full functionality restored as soon as possible.<br /><br />We will keep you updated as we progress.</p>tag:status.ipaper.io,2005:Incident/166608752023-03-28T19:17:43+02:002023-03-28T19:17:43+02:00Unable to process PDFs<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>19:17</var> CEST</small><br><strong>Resolved</strong> - This issue has now been resolved.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>08:00</var> CEST</small><br><strong>Monitoring</strong> - The issue has been resolved and we are monitoring the results.</p><p><small>Mar <var data-var='date'>27</var>, <var data-var='time'>12:02</var> CEST</small><br><strong>Investigating</strong> - We are currently experiencing issues with processing of PDFs, importing/exporting and editing enrichments.<br />We are investigating the cause of these issues.</p>tag:status.ipaper.io,2005:Incident/165103812023-03-15T17:39:07+01:002023-03-15T17:39:07+01:00Short sporadic outages<p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>17:39</var> CET</small><br><strong>Resolved</strong> - Resolving this incident as there has been no further slowdowns and all systems are operating normally.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>14:02</var> CET</small><br><strong>Monitoring</strong> - We have identified the source of the slowdowns to be a change in how we process and send logs from the application, a fix has just been released and systems should be back to normal again. We will continue to monitor the situation closely before resolving this incident.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>12:27</var> CET</small><br><strong>Investigating</strong> - We are currently experiencing short sporadic outages that can result in slow load-times or timeouts affecting the Flipbooks viewer.<br />We are actively investigating the cause of this and will update once we know more.</p>tag:status.ipaper.io,2005:Incident/160402912023-02-06T15:36:06+01:002023-02-08T13:16:45+01:00Slow load times and outages across products<p><small>Feb <var data-var='date'> 6</var>, <var data-var='time'>15:36</var> CET</small><br><strong>Resolved</strong> - This incident has now been fully resolved and all systems are operational and fully stable.<br />We appreciate your understanding and patience while our team worked quickly to resolved this๐</p><p><small>Feb <var data-var='date'> 6</var>, <var data-var='time'>14:14</var> CET</small><br><strong>Monitoring</strong> - We have identified the cause and deployed a fix and systems are returning to normal.<br />We will monitor the situation before closing this issue, we should be fully operational again.</p><p><small>Feb <var data-var='date'> 6</var>, <var data-var='time'>12:56</var> CET</small><br><strong>Investigating</strong> - We are currently seeing very slow load times of our products, and this is causing timeouts for several products.<br />We are working intensely investigating the cause of this and will update as we learn more.</p>tag:status.ipaper.io,2005:Incident/159739832023-02-02T06:00:20+01:002023-02-02T06:00:20+01:00Infrastructure Maintenance<p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>06:00</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>04:00</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>30</var>, <var data-var='time'>14:10</var> CET</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance of parts of our infrastructure that is running several of our websites and services.<br /><br />There will be multiple brief outages during this time which will disrupt service for customers using these services for several minutes at a time. Durations may vary.<br /><br />This will have no impact on our main systems for serving and processing Flipbooks - such as the Admin and Viewer.</p>tag:status.ipaper.io,2005:Incident/99785412022-05-17T14:22:57+02:002022-05-17T14:22:57+02:00SSL Service unable to create new certificates<p><small>May <var data-var='date'>17</var>, <var data-var='time'>14:22</var> CEST</small><br><strong>Resolved</strong> - We are now able to process SSL orders again.<br />We will keep monitoring, but all systems are working as expected and all orders are completing as normal.<br /><br />Thank you for your patience and we apologize for the inconvenience this has caused ๐</p><p><small>May <var data-var='date'>12</var>, <var data-var='time'>22:37</var> CEST</small><br><strong>Identified</strong> - We are seeing challenges with issuing new certificates for branded domains, we have identified the issue and are working on a solution.<br />Please note, this does not affect existing certificates for branded domains.<br /><br />Thank you for your understanding and patience while we resolve this issue.</p>tag:status.ipaper.io,2005:Incident/96549532022-03-29T12:56:16+02:002022-04-06T14:21:30+02:00Products not loading<p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>12:56</var> CEST</small><br><strong>Resolved</strong> - We are seeing no further issues with auto-deployment and the root cause was a bad configuration that caused the auto-deploy to halt mid deployment. The cause has been fixed and tested successfully.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>08:56</var> CEST</small><br><strong>Monitoring</strong> - The issue has been identified as a failed auto-deploy of new application servers. After manually rectifying the issue all products are now operational. We will keep monitoring while analyzing the root cause.</p><p><small>Mar <var data-var='date'>29</var>, <var data-var='time'>08:08</var> CEST</small><br><strong>Investigating</strong> - We're currently seeing flipbooks, Displays and Pop-ups not loading and are investigating the issue.</p>tag:status.ipaper.io,2005:Incident/94891662022-03-17T11:00:28+01:002022-03-17T11:00:28+01:00FTP Server scheduled maintenance<p><small>Mar <var data-var='date'>17</var>, <var data-var='time'>11:00</var> CET</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>17</var>, <var data-var='time'>09:00</var> CET</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>14:40</var> CET</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance during this time, at which our FTP server will be inaccessible.</p>tag:status.ipaper.io,2005:Incident/91772052022-01-27T18:44:13+01:002022-02-04T17:56:03+01:00Intermittent flipbook load failures<p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>18:44</var> CET</small><br><strong>Resolved</strong> - We are resolving this, as we are seeing no other issues.</p><p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>17:07</var> CET</small><br><strong>Monitoring</strong> - We experienced intermittent issues with our app servers, we have doubled our capacity and seeing no more errors.</p><p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>16:36</var> CET</small><br><strong>Investigating</strong> - We are currently seeing intermittent load issues of flipbooks
<br />
<br />Our team is investigating and hope to have full functionality restored as soon as possible.
<br />
<br />We will keep you updated as we progress.</p>tag:status.ipaper.io,2005:Incident/89994302022-01-04T16:28:04+01:002022-01-04T16:28:05+01:00Issues with SSL certificate issuance for branded domains<p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>16:28</var> CET</small><br><strong>Resolved</strong> - Issue has now been fully resolved and SSL is working as expected.<br />We apologize for any inconvenience this may have caused you, and we thank you for your patience.</p><p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>13:48</var> CET</small><br><strong>Identified</strong> - We have identified the issue, and a fix is underway</p><p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>13:19</var> CET</small><br><strong>Investigating</strong> - We are currently seeing certificates not being created, we are investigating.</p>tag:status.ipaper.io,2005:Incident/84302032021-11-09T16:30:09+01:002021-11-09T16:30:09+01:00Experiencing outages for popups<p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>16:30</var> CET</small><br><strong>Resolved</strong> - Popups are now working for all customers again over the last few hours.</p><p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>11:38</var> CET</small><br><strong>Investigating</strong> - We are currently investigating the issue</p>tag:status.ipaper.io,2005:Incident/82556932021-11-05T14:51:36+01:002021-11-09T14:50:05+01:00Issues with SSL certificate issuance for branded domains<p><small>Nov <var data-var='date'> 5</var>, <var data-var='time'>14:51</var> CET</small><br><strong>Resolved</strong> - After monitoring this for some time and being in close contact with affected customers, we feel confident that we can now close this issue.<br />Should you experience any problems or have any concerns please do not hesitate to reach out.<br /><br />A post mortem will be made available in the coming days.</p><p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>15:37</var> CEST</small><br><strong>Monitoring</strong> - We have deployed a fix to resolve the challenge with expired SSL certificates.<br />Due to the nature of this fix, we are unable to present content via HTTPS on a range of older operating systems and applications. This includes Android devices running 7.1 or lower.<br />We continue to monitor the situation while working with our infrastructure providers to find a more inclusive solution.</p>