Help Forums/Something's not working/Troubleshooting

Paper.li is not picking up all of the content you expect

Birgit Seitz
posted this on April 23, 2012 13:14

 

If you notice content missing from your paper, check these reasons to troubleshoot why:

 

1. Does the post fall within the relevant timeframe?

Paper.li searches the previous xx hours (24 if daily,  every 12 hours for twice daily or 7 days for weekly) for unique links (URLS) shared by you, according to the sources and key word searches you have chosen.

For Twitter, check the timestamp link on the top right of the tweet to be sure the tweet falls within the correct timeframe.  

For G+ and Facebook, dates are also included in the posts and will only be pulled if they fall within the correct timeframe.

For RSS feeds, check the feed to verify that recent content has been published by adding your RSS to any RSS reader.  (eg feedly.com)  

For youtube, dates are included in a posted video and will only be pulled if they fall within the correct timeframe.

Troubleshooting advice: Does the date of the missing post/tweet meet the criteria of your update period? If you are using an RSS feed, can the RSS feed be found in an RSS reader and if so, is there recent content?

2. Is the post unique?  

We will only display unique links, so if there are multiple users tweeting identical links or sharing the same URL on Facebook, we will take the first link detected (chronological order).

3. Is the URL shared (via RSS, Facebook or twitter) a working URL?

In the case of broken links, we filter as best we can and discard any broken links found. 

Troubleshooting advice:  Test the URL using the bookmarklet. Was content found?  If not, the page might be in a format that prevents us from detecting an article, image, or video.

4. Are the post(s) being excluded because of your filters?

If you are using a key word, check that those users are tweeting or posting on Facebook using the keyword on that list and the filters you have set.

5.  Did the source (Facebook, Twitter, G+, website) have technical issues?

A random technical issue cannot be ruled out as a culprit when we fetch content. From time to time "something" happens that prevents us from fetching content.  We have no control over outsides websites.

Check here for Twitter.

Check here for Facebook.  

6. Does the language of the article match the language criteria you set?

If you have chosen to find content in a specific language , we will discard any content found that does not match the language you have chosen.  To check your language settings, go to your Paper Settings Dashboard, choose Content and then Content language.   Please note: Our system currently fetches content in English, French, Spanish, Italian, Portuguese, Japanese, German and Dutch.

7. Have you excluded some Paper Sections?

If you have excluded specific Paper sections, but our system categorizes the content found under one of those excluded Paper sections, the content will not be published.  To check which Paper sections you have excluded, go to your Paper Settings Dashboard, click Content, then Paper sections.  Look for which Paper sections are not selected.  

Troubleshooting advice: Use the bookmarklet to view how paper.li is categorizing the article.

The bookmarklet will show which Topic section we are assigning the article.  If in the below example, the Covered Topic "Politics" had previously not been selected, the article below would not have appeared in the paper.  

Screen_Shot_2014-03-03_at_2.27.11_PM_2.png

8. If your content from Facebook or G+ is not showing up, check that the post is public.

Our system can only fetch public posts with a unique URL from Facebook or G+ that match your keyword search.  In the case of Facebook, we use their own search functionality to find public posts.

We've noticed that one word key word searches work best in Facebook.  Of course, the more general the one-word key word, the higher probability you will get un-wanted content.  For example, if I search on Facebook for "cats", I will get all public posts related to cats, in all imagined contexts. 

9.  If not an image or video, does the URL share an article?

Unless you are pulling in video or images, the link shared (either in the RSS, Facebook, Twitter, or via the bookmarklet) must follow a webpage article structure.  If there is no article shared, we can not pass the link onto a Paper.li paper.

10.  Has the website or news sharer been blacklisted from your paper?

Go to your Paper Settings Dashboard, click Content and scroll down select Blacklisted people or Blacklisted websites to check that the missing URL or news sharer or website has not been (accidentally or not) blacklisted from your paper in the past.

11.  If the missing content is a video, has the "embed" setting been disabled?

Some videos from Youtube cannot be published through the Paper.li bookmarklet (such as http://www.youtube.com/watchfeature=player_detailpage&v=qq7fbMbJHsE).

If the owner of the video has requested that the video is not embeddable, then we will not be able to pull in the video to a paper.li.

To check if this is the case for the video you are trying to fetch, go to the the video in youtube.com, click "share" below the video, then "embed.  If the video says "embedding disabled by request", then we will not be able to pull in the video.

Screen_Shot_2014-02-06_at_3.57.35_PM_2.png

 

 

 

What should I do if none of these reasons apply to my case?

We are continually working on improving our web crawler to optimize how we pull content from the web.  If none of the above situations apply to you, we can investigate.  Tweet us at @smallrivers with the following information:

(1) your paper URL,

(2) the edition date of the paper that had content missing, and

(3)    For Twitter: the URL of the tweet(s)* that were not included 

For Facebook: the keyword you are trying to search on

For G+, the URL that was not included.

For an RSS feed: the name of the RSS feed and the URL of the article which was not included

If using the bookmarklet: the URL which you are trying to add.

 

* To capture the URL of a tweet, click on the timestamp in the upper right hand corner of the tweet.  Copy the URL of the missing tweet to send to us.  

Tweet.png 

 

Last updated:  Julia Yaziji March 3, 2014

 
Topic is closed for comments