Roll your own wine RSS feed

March 19th, 2007 by james

The volume of wine information available online today can be overwhelming. There are wine forums, wine communities, winery sites, wine association sites, wine region sites, wine blogs, and much more. With new content often being added to these sites by the second, it’s nearly impossible to keep up. And if you just want to stay informed on a specific wine related topic, such as the latest discussions about your favorite winery, how do you sift through the river of new content to find what you really want to read?

What if you could design your own RSS feed that pulled together the latest happenings for just the topics you were interested in? Well, a small but powerful feature was just added to Scrugy that allows you to do just that. Here’s how it works.

Say your favorite wine region is Paso Robles and you’d like to build an RSS feed that provides the latest wine blog posts mentioning the area. The first thing you’d need to do is submit a blog search on Scrugy for “paso robles”.  To do this just type “paso robles” (in this case include the quotes so Scrugy treats it as a phrase–this will improve the accuracy of the results), select “just wine related blogs” from the search type drop-down, and click “Search”. The search results will show you all blog posts with the phrase “paso robles”. Now since you want the feed to always show you the latest blog posts, sort the results by newest to oldest by clicking on the “Newest” link (just above the first search result). Great, now you’ve got the results the way you want them. The last step is to grab the RSS feed for the search so you can add it to your favorite RSS reader. This is where the new feature comes in. You will notice a small orange “XML” image along the upper right side of the search results page. This link will provide the very same search results of your search but in RSS format. Right-click to copy the link to your computer’s clipboard so you can paste into your favorite reader.

Now whenever you access this feed you will receive the latest results from Scrugy. Comments? Suggestions? Let us know. Also, thanks to eljefe from Twisted Oak Winery Blog for suggesting the feature.

WineLog.net tasting notes indexed on Scrugy

March 17th, 2007 by james

During the most recent Wine 2.0 online chat, Jason Coleman, co-founder of WineLog, asked about using microformats for the tasting notes on WineLog and getting them indexed on Scrugy. By reviewing some of the basic hReview information on Wineformats.org and some of the wine specific class names recognized by Scrugy, Jason was able to quickly annotate some pages on WineLog to become microformat enabled. The beauty of microformats and what makes them so easy to integrate is that you can apply them to your existing markup without changing the layout or look of your pages.

The next step was to get them indexed on Scrugy. This happens one of two ways. Either the Scrugy crawler will pick them up when it periodically crawls pages on WineLog or Scrugy can pick them up from an RSS feed.  The RSS feed is the better way to go, though, since it will get the most recent tasting notes indexed as the RSS feed is updated on WineLog. The crawler is somewhat random and may only periodically visit WineLog. Since Jason has an RSS feed for the latest WineLog updates, I added this feed to the ever growing list of wine-related RSS feeds that Scrugy monitors. There was one catch, though. In order for Scrugy to pick up microformats in RSS feeds, the feed items themselves must be formatted with microformats too. Since that was going to be a lot more work for Jason, I made some changes to Scrugy to follow the links (i.e. the <link> element) associated with each RSS item and check those pages for microformats. Since the pages pointed to the by links were the ones Jason had changed, Scrugy picked them just fine. So now the Scrugy crawler will detect tasting notes on WineLog as well as the Scrugy RSS feed fetcher.

Read the rest of this entry »

More wine content milestones

March 10th, 2007 by james

Scrugy continues to grow as the Internet’s best resource for wine information. As of today Scrugy has over 6.3 million pages in its index from wine related sites. That’s right! When you perform a search on Scrugy, you’re results will always be about wine and will come from the Internet’s largest resource of wine information. And when you combine Scrugy’s immense web search capabilities with a blog search engine covering over 130,000 wine related posts, why would you trust your wine searches to any other site?

Wine Blog Search

March 8th, 2007 by james

Besides aggregating the best that the web has to offer on wine related content and tasting notes, Scrugy is also a state-of-the-art search engine.  But did you know that Scrugy allows you to limit your search to just wine blogs? To do a blog search, enter a search phrase in the search box at the top of any Scrugy page, click “double down arrow” to display the “search within” drop-down, select “just wine related blogs”, and then “Search”.

Since I’m drinking a Concannon Petite Sirah this evening, a search for blogs mentioning this wine would look like the following screen shot.

Once I click the “Search” button, Scrugy displays the results ordered by relevance. But what if I want the results ordered by the most recent blog post? No problem. Scrugy allows you to order results by relevance or by the newest or oldest post date.

Why risk your wine searches to any other site? Scrugy delivers the results you’re looking for the way you want them.

Suggestions? Comments? Let us know.

Half million more pages added to Scrugy’s wine search index

December 30th, 2006 by james

Although I’ve been taking a break from blogging about Scrugy, the site has continued to grow in users, hits, and pages indexed. In fact, the search index just went over 4.7 million pages on wine. That’s an increase of a half million pages since October (the last time I blogged about the page count).

Now that the holidays are just about wrapped up, I’ll be writing about upcoming enhancements to the site. And if you have any ideas for how to improve Scrugy, be sure to let me know either by submitting feedback or commenting here.

Wine community development web 2.0 style

November 17th, 2006 by james

Earlier this week I asked if others in the wine 2.0 community would be interested in collaborating on defining and describing how we can start representing wine information using structured web concepts. Namely, adopting existing microformats where appropriate and helping to shape future microformats where necessary.

I’ve dubbed this initiative Wineformats.

We’ll be discussing ideas and issues related to this effort on a new Wineformats Google Group and will be publishing the results of our work on the Wineformats wiki.

If you’re interested in getting involved, check out the wiki and join the discussion group. And this initiative is not just for the programmer types out there. Anyone with wine domain expertise or an interest in shaping the next wave of innovation for the online wine community is welcome.

Wine and the Semantic Web

November 14th, 2006 by james

It’s exciting to see other folks starting to pick up on the potential of the semantic web and wine. At Scrugy we’ve already laid the groundwork for mining microcontent embedded in web pages and RSS feeds. In fact, the first phase has already been implemented in our wine-smart web crawler and feed aggregation services where we are harvesting wine review information from tasting notes formatted using microformats.

So what else is possible with the marriage of microformats and wine related content? Well, here is a glimpse of our roadmap in this area.

We see tremendous potential in the development of open specifications for representing lots of other structured wine information. For example, on winery web sites alone the hCard/adr and geo microformats can be used when displaying contact information, tasting room addresses, and GPS coordinates. In addition, hCalendar can be used when listing winery events and hListing when listing wine releases.  Of course, wine retail sites can also use hListing.

The possibilities for developing applications that leverage this information are very exciting. Let’s consider what’s possible with a site like Scrugy. Since Scrugy is an aggregator of wine information, it will automatically pick up winery addresses, geo coordinates, events, wine releases, and so on from winery sites that are using microformats when they’re crawled. That means these wineries will only be responsible for keeping their websites up-to-date and will no longer have the chore of propagating updated information out to the many sites that list information on them. Essentially what we’re talking about here is turning the current model inside out where wineries will no longer have to push data out but instead tools like Scrugy can come and get the information. Updates are then more timely and perhaps most importantly the distributed information is more accurate.

Circling back to tasting notes and microformats, the advantages for the wine consumer are equally appealing. At the end of my last post on HDTNs (High Definition Tasting Notes), I touched on the power of aggregating structured wine review information. Consider the situation where a tasting note aggregator such as Scrugy has developed a detailed tasting descriptor profile for a particular wine. This profile would be the result of summarizing tasting notes from several sites and employing an authority weighting for tasting notes from reviewers of distinction (critics, wine makers, and so on). Then consider a wine newbie who comes along and can only tell you the name of a wine that they liked. Scrugy can take the dominant tasting descriptors from that wine and find different wines with similar profiles. This opens the door to extremely powerful and accurate wine recommendations and the opportunity to discover wines from producers and regions that previously may never had been thought possible.

So of the other Web/Wine 2.0 companies out there, who is ready to take the next step? Andrea Johnston with Inertia Beverage Group is already calling this “Wine 3.0″.  Is there anyone willing to join me in defining open specifications for bringing the semantic web and wine together? I’d be happy to host a wiki to get things going.

So is this stuff only good for wine geeks?

November 14th, 2006 by james

Tim over at Winecast is debating the question of whether “wine 2.0″ sites like Scrugy are just for (wine) geeks. Naturally I’ve got an opinion (or two) on this.

First, like Tim, I must admit up front that I am something of a wine geek (link to my personal blog) and I’m absolutely a tech nut. Over the years as a software developer I’ve seen many technical trends on the Net come and go. Sure there are some concepts that go nowhere but you can pretty much count on nearly every effort contributing somehow to the evolution of the Internet. Some ideas contribute more than others but the overall application development ecosystem on the Internet will take it all in and bubble the best ideas to the top. My point in all this is that we are still very early in the lifecycle of the Internet and to claim that one type of application that is popular in one sector will never be successful in another (i.e. wine) is a tough call to make.  Are any of the web 2.0 sites focused on wine even a year old? Heck, most wine blogs are less than a year old too.

Another point that I’d like to make is that the first users of almost every new site are geeks. Let’s face it. We geeks are always online, checking out new sites and ideas the moment they’re unveiled. So of course the initial user base of a new crop of applications will have a heavy geek factor. Does this mean that these sites will ultimately fail to gain mass appeal? The challenge, as I see it, is for these sites to continue to evolve and mature, building upon a proven formula, until they hit on the right implementation. I think Cork’d is a great example of a young wine web 2.0 site that seems to appeal most to the non wine geek. In fact, I’ve heard several wine geeks say that Cork’d just doesn’t have enough of the techno wine geek features they’d like to see.

I hope we all can agree that wine related sites have a place online. Wine quality continues to improve around the world and good quality wine is easier than ever to find at lower price points. As wine continues to reach new heights of popularity, especially in the new world, wine newbies will naturally look online to feed their new interest. But what will they be looking for and how will they want to access information about wine? Buying wine online is a no-brainer. But how does someone new to wine get to the point of making a purchase decision? You’re lucky if a wine newbie can tell what they like and dislike in wine let alone naming a specific wine that they liked. I believe that this is where wine sites need to start. That is, easy, intuitive, and approachable access to information on wine. This is exactly what we’re trying to provide on Scrugy. Are we there yet? Probably not. Are moving in that direction? You bet!

What do you think?

Introducing High Definition Tasting Notes

November 13th, 2006 by james

The tasting note is an elusive and sometimes controversial and intimidating part of the wine world. Anyone can create them but few of us do. Some people swear by them while others hate them. A few make a living off of them while others scribble them on napkins. Some live out their fantasies as poets in their tasting notes while others use cryptic shorthand that only they can understand. Tasting notes can make or break a winery or can end up crumpled in someone’s pocket destined for the spin cycle never to be seen again.

For those tasting notes that actually make it online, we want to help them live up to their full potential. That is, to offer a usable profile of not only the wine and producer but also of the reviewer. What do I mean by this? Well, imagine if you could take all tasting notes written in any language for a particular wine from several web sites, normalize their scores into a consistent scale, extract and summarize the tasting descriptors from all reviewers, apply an authority filter to add weight to tasting notes from recognized experts, and then provide a single global view of the wine from all of this information. This would give you a powerful tasting profile of a wine that is the true result of what people are actually experiencing. And this view can be expanded to provide tasting profiles at the vintage, producer, region, and varietal levels. Sound interesting? Scrugy is already doing this today!

Recently I wrote about Scrugy’s support for microformats. In this post I’d like to take it a step further and talk about what I like to call High Definition Tasting Notes, or HDTNs.

Read the rest of this entry »

Scrugy, the ultimate wine mashup

November 6th, 2006 by james

With all the attention that wine sites with map mashups have been receiving lately, we feel compelled to point out that Scrugy has had  maps integrated on its wine region and winery detail pages for months.

For example, check out Scrugy’s Dry Creek Valley page. Not only does Scrugy integrate the Yahoo! Maps service to give you satellite and map views of the area, we also include local weather conditions, community average score, and a tag cloud of the wine community’s tasting descriptors/tags for the region. And when we say community, we’re not just talking about Scrugy users here. Scrugy aggregates wine information from several sites that provide tasting notes–a much more accurate representation of the wine community.

The winery detail page provides a similar view with a map of the winery’s location, local weather, and community score and tags from tasting notes for the winery. Staying within the Dry Creek Valley, check out the David Coffaro page on Scrugy.

Look for more great aggregated data and information on Scrugy in the coming days.