Posts by Rapid7

5 min IT Ops

Log Management 101 - Where Do Logs Come From?

We’ve had a lot of people asking for the Log Management [https://www.rapid7.com/fundamentals/what-is-log-management/] Primer for a while now. And, surprisingly, many of these folks have a strong technical background, including developers. Some want it for themselves, and some want it to pass on to a colleague, manager, etc. I’m going to explain what logs are, where they come from and how you can get your logs. If you’re a developer, this post probably isn’t for you as we don’t dig into the code

3 min IT Ops

Where Are My AWS Logs?

Over my time at Logentries, we’ve had users contact us about where to find their logs while they were setting up Logentries [https://logentries.com/centralize-log-data-automatically/?le_trial=aws_logs-logentries_blog-post_cta-create_trial&utm_campaign=aws_logs&utm_source=logentries_blog&utm_medium=post_cta&utm_content=create_trial] . As a result, we recently released a feature for Amazon Web Services called the AWS Connector, which automatically discovers your log files across your Linux EC2 ins

3 min IT Ops

How to Easily Get All Your Logs from AWS EC2

Let’s say that you, like many of your colleagues, are hosting your application on AWS’s EC2 cloud infrastructure. You’re chugging along at a steady rate of growth when BAM! One day you get a spike of traffic and have to scale up quickly. “Good job,” you think as you pat yourself on the back in your mind, “this choice to host in the cloud means we can easily handle this load spike without a problem. We’ve set it to auto-scale, so we’ll have all the instances we need.” But is everything all good?

4 min IT Ops

How To Track Peak Load and Memory Usage vs Response Time on Heroku

A few months back Heroku introduced log-runtime-metrics, which you can enable [https://devcenter.heroku.com/articles/log-runtime-metrics#enabling] from the command line to insert CPU load and memory usage metrics into your log events at 20 second intervals. Like all log data in its raw format it’s not massively useful to see metrics getting dumped into your logs every 20 seconds. That’s not exactly what Heroku had in mind, however. At the same time they introduced log-runtime-metrics, Heroku al

5 min IT Ops

How To Receive Log Alerts Via Flashing Lights In Your Office or Home

This is a guest blog post by Jason Ruane, the technical director atMoposa [http://www.moposa.com/], a place for brides and grooms to plan and manage their wedding. In this post Jason describes how he used a Wi-Fi enabled light and Logentries alerts to receive Logentries alerts via flashing lights in his house. Jason and his team are long time users of Logentries, analyzing all their logs from multiple servers in one centralized, cloud location. How I receive my Logentries alerts via home lighti

2 min IT Ops

How to Log Client-side JavaScript Events – Logging for the Web with le.js

At Logentries we provide a comprehensive collection of client libraries [https://github.com/logentries]and inputs [https://logentries.com/doc/inputs/] which make it easy to dispatch log events from any tier in your existing infrastructure. Until now though, one platform has been left out, and it’s the most ubiquitous and widely-understood of all- the browser. Collecting events from the browser presents a number of challenges which have hindered the development of a viable solution: * There’s n

2 min IT Ops

Field-level search

Back in July we announced a substantial improvement to our search functionality, searching your log data with logical operators [/2013/07/searching-with-logical-operators/]. Today we are happy to announce another big step in improving our search facility. You can now perform ** field-level searches [https://logentries.com/doc/search/]**in Logentries. Field-level searches allow you to search for events where a particular field is equal to, less than or greater than a particular value and thus al

3 min IT Ops

Build your own SMS Alerts--Logentries and Clickatell Combined!

* [/content/images/le-img/2013/07/Moposa2.jpg] This is a guest blog post by Jason Ruane, the technical director at Moposa [http://www.moposa.com/], a place for brides and grooms to plan and manage their wedding. In this post Jason, describes how he used Logentries webhook alerts and Clickatell to receive Logentries alerts via SMS. Jason and his team are long time users of logentries, analyzing all their logs from multiple servers in one centralized, cloud location. How I receive my Logentries

3 min IT Ops

How to Best Structure your Logs: Log Analysis Tips and Best Practices with Gal Segal from eToro

This week we have a guest blog post by Gal Segal. Gal is an engineer at eToro [https://www.etoro.com/en/platforms/openbook/], the worlds Largest Social Trading & Investment Network. In this post Gal shares his thoughts on log analysis best practices including tips on how best to structure your logs as well as some useful patterns that can be applied within your log events. He also discusses how to use Logentries’ new log search [https://logentries.com/doc/search/] functionality to more easily

3 min IT Ops

Customer Spotlight with Adept Mobile: Ever wonder how the New England Patriots/Miami Dolphins/Boston Celtics handle website demand capacity

We’re launching a new customer Q&A series, where we chat with our customers about how they’re using log data [https://logentries.com/about-us/], their technology stack, and their overall industry insights. We love talking to our users, because we always learn something new – and we’d like to share those insights with you. In our first interview, we caught up with Craig Heneveld, Director of Technology at Adept Mobile in Boston, to talk about the development challenges and successes of bringing

2 min IT Ops

Heroku Account Consolidation-Single View of all your Logs

If you host multiple apps on Heroku, you know the pain of having to log in to a separate add-on account for each of your Heroku apps. Whether you’re monitoring several different production applications, have separate apps for your production, staging, and test environments, or are a consultant in charge of administering separate applications for each of your clients you know how irritating it can be to constantly have to switch between accounts. This is particularly annoying when you’re trying

1 min IT Ops

Switching between UTC and local time

All Logentries servers are configured for the UTC timezone. We use this as the default timezone for all internal data including customer’s logs. However, at the browser UI level we detect a user’s local timezone and present all dates in a more human friendly way, i.e. in the local time. We now allow users to change their time zone to UTC. This can be very handy when you manage systems in multiple regions or have a distributed development team where you want to have a common timezone that you ca

1 min IT Ops

Per-log retention period

Typically, you would like to keep logs from development environment (with all debugging messages enabled) for only a limited amount of time, while production logs far longer. Up to now you had to set the retention period for the whole account, keeping development logs longer than needed. We are happy to announce per-log retention configuration! It gives you the option to fine-tune your retention policy in a more fine-grained manner than with a default per-account setting. To set a new log retent

2 min IT Ops

Getting terminal colors right

As a part of our work on ANSI escape code coloring, I looked in detail at default colors used in different command line terminals. It appears form the Wikipedia article [https://en.wikipedia.org/wiki/ANSI_escape_code] that colors are set at their brightest level with minor variances across implementations: [/content/images/le-img/2012/11/pals.png] Adapting these color schemes gives the result as in the following picture: [/content/images/le-img/2012/11/lumi0.png] If you try to read the te

1 min IT Ops

Feature requests

There are so many thing we can do with logs. We have a pile of new ideas on how to make Logentries better and we spend time implementing these every single day. We also collect feature requests from you, our lovely users. But we want to do more – we want to include you to the whole process of future development. We are happy to announce our Feature requests page, a page that enables you to add new feature requests, vote on them, and add comments with more details. Access the page from the sideb