mongoid / mongoid_search Goto Github PK

Hello

Can I define a way to search over an array field? I'm trying to keep a breadcrumb of names in a model to simplify search. For that, there's a callback to create an string Array:

class Product
  include Mongoid::Document
  include Mongoid::Search

  search_in :name, :description, :breadcrumb

  field :name
  field :description
  field :breadcrumb, :type => Array 

end

The ideal way would be able to add :breadcrumb to all _keywords... not happening today

possible? Dunno if this is a bug or a non-feature :)

The dependency gemattack causes a terminal message which routes you to some malicious sites.

I have used your gem 6 months ago. its very useful thank you..
but when running 'bundle install' it asked me to update mongoid to 3.0

Bundler could not find compatible versions for gem "mongoid":
  In Gemfile:
    mongoid (~> 2.4.8)

    mongoid_search depends on
      mongoid (3.0.0)

but my app sill not compatible with mongoid 3
it would be nice if separate it in different branch :-)

You have released the 0.2.0 with jeweler, rspec, etc as runtime dependencies.
https://rubygems.org/gems/mongoid_search/versions/0.2.0

The README reports for referenced relations. Does mongoid_search works for embedded one to many models (http://mongoid.org/docs/relations/embedded/1-n.html) ?

Can I have an example ?

mongoid 2.0.0 seems more encourage the user to use the active record macro like

• has_many
• has_one
• belongs_to
• has_and_belongs_to_many
  because in the documentation at the mongoid site, now doesn't show the reference_one / references_many / referenced_in syntax anymore.

could you update the example, to make the user of mongoid_search easier to adopt this gems

thanks

This is not an Issue, this is a suggestion :)

I've some troubles using MongoId 2.0.2, and the unstable 2.1.0, solved some of them.
But because the mongoid_search has a dependency on the 2.0.0 versions (~> 2.0.0).

I don't know how good it's can be, but you can remove this version check?
I made my fork (https://github.com/fellix/mongoid_search) removing that version, and that's I'm using this branch.

Keep the good project.
Best Regards

this is my model

class Article
include Mongoid::Document
include Mongoid::Search

field :body, :localize => true
search_in :body, {:match => :any, :relevant_search => true }
end

and this returns always nil

Article.create!{:body => "hello world")
Article.search("hello").first

i have tried also below things but no luck

search_in :"body.en", {:match => :any, :relevant_search => true }
search_in :"body_translations.en", {:match => :any, :relevant_search => true }

i'm a mongo rookie and maybe i missed something, but if someone can give a tip i will be appreciated

thanks

For example, I had a search field 'body' for Blog model. In most cases, the body field will contains html tags, like

"<h4>This is a sample blog entry</h4><div><p><img src=\"/uploads/picture/data/DSC_0277.jpg\" style=\"width: 400px; height: 268px;\"></p><br></div>"

So how to strip the html tags when setting keywords on the search field?

I have the following model definitions

field :name, localize: true
search_in :name

In the database, I see data stored as:

name: { "en" : "Amazon"}
_keywords: [ "amazon" , "en"]

This causes any search for 'en' to return all results. Is there a way to stop that? I read the other post and this doesn't work:

search_in :name => :en

Hi,
I cannot use desc, asc or paginate while full_text_search.
Model.full_text_search(query).desc("updated_at") is not working.
And also cannot sort on relavence.
Thanks,
Aashish

Do you have any idea for has_and_belongs_to _many relation search?

I have install gem as it is described
my Model
class Employee::Material
include Mongoid::Document
include Mongoid::Timestamps
include Mongoid::Search
field :name, type: String
field :status, type: Integer
field :asset_tokens
belongs_to :employee, :class_name => "Employee::Employee"
has_and_belongs_to_many :assets,:class_name => 'Asset'
search_in :assets => :name
validates_presence_of :status

def asset_tokens=(tokens)
self.asset_ids = Asset.ids_from_tokens(tokens)
end
def self.column_names
self.fields.collect { |field| field[0] }
end
end

my controller
class Employee::AssetsController < ApplicationController
def index
@employee = Employee::Employee.find(params[:id])
@employee_assets = Employee::Material.full_text_search("c")
end

But it gives result all instead to give value of c only.. Where m i wrong??

why you dont update the gems?
mongoid_search last updated in September 17, 2010

gem 'mongoid_search', :git => 'git://github.com/mauriciozaffari/mongoid_search.git' doesn't work.

mongoid_search at C:/Ruby192/lib/ruby/gems/1.9.1/bundler/gems/mongoid_search-11f8caa247d6 did not have a valid gemspec.
This prevents bundler from installing bins or native extensions, but that may not affect its functionality.
The validation message from Rubygems was:
    ["lib/mongoid_search/keywords_extractor.rb", "spec/keywords_extractor_spec.rb", "spec/spec.opts"] are not files

I get an error, "Don't know how to build task 'mongoid_search:index'", when running the rake task.

rake mongoid_search:index

undefined method mb_chars' for {"File Type"=>"image/png"}:Hash /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid_search-0.1.2/lib/mongoid_search/keywords_extractor.rb:4:inextract'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid_search-0.1.2/lib/mongoid_search/mongoid_search.rb:33:in block in set_keywords' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid_search-0.1.2/lib/mongoid_search/mongoid_search.rb:29:inmap'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid_search-0.1.2/lib/mongoid_search/mongoid_search.rb:29:in set_keywords' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/activesupport-3.0.1/lib/active_support/callbacks.rb:424:in_run_save_callbacks'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/activesupport-3.0.1/lib/active_support/callbacks.rb:93:in run_callbacks' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid-2.0.0.beta.20/lib/mongoid/persistence/update.rb:43:inpersist'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid-2.0.0.beta.20/lib/mongoid/persistence.rb:79:in update' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/mongoid-2.0.0.beta.20/lib/mongoid/persistence.rb:125:inupsert'
/data/Projects/Code/Personal/metaparser.net/app/controllers/parser_controller.rb:252:in perform' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/job.rb:146:inblock (3 levels) in perform'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-result-1.0.1/lib/resque/plugins/result.rb:41:in around_perform_meta_result' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/job.rb:145:inblock (2 levels) in perform'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/job.rb:153:in call' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/job.rb:153:inperform'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/worker.rb:157:in perform' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/worker.rb:124:inblock in work'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/worker.rb:110:in loop' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/worker.rb:110:inwork'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/resque-1.10.0/lib/resque/tasks.rb:24:in block (2 levels) in <top (required)>' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:636:incall'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:636:in block in execute' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:631:ineach'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:631:in execute' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:597:inblock in invoke_with_call_chain'
/home/alex/.rvm/rubies/ruby-1.9.2-p0/lib/ruby/1.9.1/monitor.rb:201:in mon_synchronize' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:590:ininvoke_with_call_chain'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:583:in invoke' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2051:ininvoke_task'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2029:in block (2 levels) in top_level' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2029:ineach'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2029:in block in top_level' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2068:instandard_exception_handling'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2023:in top_level' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2001:inblock in run'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:2068:in standard_exception_handling' /home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/lib/rake.rb:1998:inrun'
/home/alex/.rvm/gems/ruby-1.9.2-p0/gems/rake-0.8.7/bin/rake:31:in <top (required)>' /home/alex/.rvm/gems/ruby-1.9.2-p0/bin/rake:19:inload'
/home/alex/.rvm/gems/ruby-1.9.2-p0/bin/rake:19:in `

Using rails 4 rc2, mongoid master (4.0), ruby 2.0.0..

I keep getting

../gems/mongoid_search-0.3.2/lib/mongoid_search/railtie.rb:4:in `<top (required)>': uninitialized constant Mongoid (NameError)
../gems/mongoid_search-0.3.2/lib/mongoid_search.rb:3:in `require'
../gems/mongoid_search-0.3.2/lib/mongoid_search.rb:3:in `<top (required)>'
.
.
.

Any pointers on this

It would be great to implement ruby-stemmer library

https://github.com/aurelian/ruby-stemmer

mongoid_search:index rake task doesn't seem to be included in the installation... I am using mongoid (3.1.2) and mongoid_search (0.3.2).

I ran rake db:mongoid:create_indexes, but that didn't reindex.

Any help would be much appreciated!

Hi.

probably it would be a good idea to make it compatible with https://github.com/wilkerlucio/mongoid_taggable

what do you think?

best whishes
marcel

For my personal use i created the following monkey path:

module Mongoid::Search
module ClassMethods
def search(query)
if query.to_s.empty?
self.all
else
self.send("#{self.match.to_s}_in", :_keywords => KeywordsExtractor.extract(query).map { |q| /#{q}/ })
end
end
end
end

is it possible to have mongoid_search give results even when only one character is given?

How i could implement a Stop List Feature. to filter the Generated Keyword from the KeywordExtractor

Loving the ease of the gem, only I've stumbled upon a bug or non-feature. Getting the following error while searching in a referenced association:

NoMethodError: undefined method `map' for #Category:0x102fbe5c0

With the following code:

class Product
include Mongoid::Document
include Mongoid::Search

field :name
referenced_in :category
search_in :name, :category => :name
end

class Category
include Mongoid::Document

field :name
references_many :products
end

It's probably expecting an array.

I am unable to run the rake task "mongoid_search:index".

As a work-around, I just copied the source and created it locally within my project.

Stack trace:

rake mongoid_search:index --trace
rake aborted!
Don't know how to build task 'mongoid_search:index'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/task_manager.rb:49:in `[]'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:148:in `invoke_task'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:106:in `block (2 levels) in top_level'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:106:in `each'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:106:in `block in top_level'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:115:in `run_with_threads'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:100:in `top_level'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:78:in `block in run'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:165:in `standard_exception_handling'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/lib/rake/application.rb:75:in `run'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247@global/gems/rake-10.1.0/bin/rake:33:in `<top (required)>'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247/bin/rake:23:in `load'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247/bin/rake:23:in `<main>'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247/bin/ruby_noexec_wrapper:14:in `eval'
/Users/dparker/.rvm/gems/ruby-2.0.0-p247/bin/ruby_noexec_wrapper:14:in `<main>'

Gems:

• mongoid (4.0.0 d0fc225)
• mongoid-paperclip (0.0.8)
• mongoid_search (0.3.2)
• rake (10.1.0)

If you have an email field searchable it returns all emails when you search for any email address at all. I guess this has something to do with all of them having an "@" symbol.

Hello can you please add

rake mongoid_search:index # Goes through all documents with search enabled and indexes the keywords.

To the main documentation?

Thank you

ERROR: While executing gem ... (Gem::DependencyError)
mongoid_search requires mongoid (~> 2.0.0)

(I am using mongoid 2.0.0.rc.8 which apparently does not qualify).

Hi,

Can we use Mongoid Search at Heroku. Do we need to add any paid addons to get it work.

Thanks..

KeywordsExtractor erases russian chars(for example а б в г д е ... я)

Please update gem to current release in rubygems. It was last updated there in august 2011. Thanks!

Hi,

Thanks for this gem. It's very helpful, but I'm running into an issue while testing.

I have 2 associated models:

class Organization
  include Mongoid::Document
  include Mongoid::Search

  field :name
  field :description

  has_many :locations

  search_in :name, :description, :locations => [:name, :description, :keywords]
end

class Location
  include Mongoid::Document

  field :name
  field :description
  field :keywords, type: Array

  belongs_to :organization
end

Any tests that look for the search term in any of the Location (child) fields fail. Tests that look for the search term in the Organization (parent) name or description field work.

Here are my factories:
Organization:

FactoryGirl.define do
  factory :organization do
    name "Generic Agency"
    description "Cooking classes"
  end
end

Location:

FactoryGirl.define do
  factory :location do
    name "Samaritan House"
    association :organization, factory: :organization
  end
end

The issue is that when you create the location factory, it doesn't automatically save the organization.

loc = FactoryGirl.create(:location)
loc.organization._keywords
# => ["generic", "agency", "cooking", "classes"]

Since the organization's _keywords does not include the location's info, this test fails:

it "returns locations whose name field includes the search term" do
  location = create(:location)
  get :search, keyword: "samaritan"
  name = response.parsed_body["response"].first["name"]
  name.should == "Samaritan House"
end

The only way to make the tests pass is to add an after(:create) block in the location factory to save the organization:

FactoryGirl.define do
  factory :location do
    name "Samaritan House"
    association :organization, factory: :organization
    after(:create) { |loc| loc.organization.save }
  end
end

Can it search text through associations also?
http://stackoverflow.com/questions/15050010/how-to-search-data-inside-relations-in-mongodb

Rails version: 4.1.4

rake -T | grep mongoid

does not show task for mongoid search

It works perfectly for me
has_and_belongs_to_many :assets,:class_name => 'Asset'
search_in :assets => :name

Now in another model in want to search through belongs_to relation
belongs_to :job, :class_name => 'Job'
search_in :job => :job_title
But it is not workin. Dont know what is the problem
there is value but it returns blank value.
This is my model
class Employee::Review
include Mongoid::Document
include Mongoid::Timestamps
include Mongoid::Search
field :name, type: String
field :total, type: Integer
field :percentage, type: Integer
field :count, type: Integer
field :option
field :status, type: Integer
field :comment, type: String
validates_presence_of :status

belongs_to :employee, :class_name => "Employee::Employee"
belongs_to :user, :class_name => 'User'
belongs_to :job, :class_name => 'Job'
search_in :job => :job_title

and this is my controller
@reviews = Employee::Review.full_text_search("month")

I tried defining an index that looked like this:

class Product 
index({ partner: 1, status: 1, visible_in_marketplace: -1, _keywords: 1, created_at: -1 }, { name: 'search_by_newest' })
end

And then I'd trigger mongoid_search using this query:

Product.where(:partner => 'happy', :status => 2, :visible_in_marketplace => true).full_text_search('oil eliminator').desc(:created_at).limit(50).explain

The explain() result shows that Mongoid ends up using a totally different index, since it's only responding to the where() part of the query. Is there any way to ensure that Mongoid uses the whole query to evaluate? My searches are hitting 600-800ms a piece because of this weirdness.

Hi there. I have the below implementation of this gem, on my User Model, and apart from the info field the other ones are regular strings.

# user.rb
field :info, type: Hash
search_in :uid, :provider, "info.name", "info.email", { match: :any }

Although I would expect this to return any records matching with the query in any of those fields. I have about 200 records, where one of them is named Glen Roob. Searching (using csearch) for the word: "Glen" will not, as I would expect return this record.

@users = User.csearch(params[:search].to_s)

So my my question is: (a) Am I implementing this wrong or (b) is this in fact a bug?

// E

she be old and hurts

Hi, someone know if this gem is working in rails 4 with mongoid > 4 ??

Is it possible to search in dates with different format than stored ?

created_at fields are stored like 2013-07-01 ..., but when searching it makes much more sense typing 07/01/2013.

How can I achieve this ?

class Product
  ...
  embeds_many :subproducts

  search_in :subproducts => [:name, :brand]
end

Raises:
TypeError: wrong argument type Array (expected Proc)

Hey there again, quick one:

• why can't I map number to keywords? any particular reason? It would be good, specially when dealing with number related content (car search, for instance) :)

Like, being able to search "Ford 2011" would be great...

possible?

cheers!

Hello!

The problem is in "lib/mongoid_search/util.rb" file
Examples:
1)
input: "Александр".to_s.mb_chars.normalize(:kd).to_s.gsub(/[._:;'"`,?|+={}()!@#%^&*<>~$-\/[]]/, ' ').gsub(/[^[:alnum:]\s]/,'')
output: ""

input: "Alexander".to_s.mb_chars.normalize(:kd).to_s.gsub(/[._:;'"`,?|+={}()!@#%^&*<>~$-\/[]]/, ' ').gsub(/[^[:alnum:]\s]/,'')
output: "Alexander"

To solve the problem I have replaced regexp
gsub(/[^[:alnum:]\s]/,'')
with
gsub(/_/,'')

I don't know is it right or not but it works =)

We have some preexisting code that seems to be breaking. We used to be able to chain calls with all, but now it's not working:

Artist.csearch('brel').all(sort: [:name, :asc]).length # => 0
Artist.csearch('brel').length # => 2
Artist.all(sort: [:name, :asc]).csearch('brel').length # => 0
Artist.csearch('brel', sort: [:name, :asc]).length # => 2

Is the last one the proper way to do it? Our previous code just calls all, then we check for a param, if its' given or not, and if it's given, then we go ahead and chain on this csearch.

I get this:

DEPRECATION WARNING: The InstanceMethods module inside ActiveSupport::Concern will be no longer included automatically.

when I include this into model

include Mongoid::Search

If I use special characters for search it returns all documents:

class User
  include Mongoid::Document
  include Mongoid::Search

  field :name
  search_in :name
end

User.create( name: 'lala' )
User.create( name: 'lele' )
User.create( name: 'lolo' )

User.count
 => 3

# it should return 0 documents but returns all document 
User.full_text_search('.').count
 => 3
User.full_text_search('+').count
 => 3

# it works ok
User.full_text_search('a').count
 => 1

This is a bug ?

When running the rake task to index I get the following error:

rake mongoid_search:index
rake aborted!
undefined method `each' for nil:NilClass

Tasks: TOP => mongoid_search:index

Is there a fork that is being maintained. There are a bunch of issues that no one has even responded to...

the undocumented connection to the a.ttack.tk server is preventing the gem from working in china. while there is a way to turn it off the fact that the connection and the switch are both undocumented.

please document the feature and provide a better way to disable it than the environment variable (through a configuration maybe).

as a note, the fact that those two are undocumented caused a lot of wasted time on my project trying to figure out why certain people on my team were having problem while others with the same exact environment were not.

regards,

Jean-Marc Lagacé

I want to implement this great gem with the gem mongoid_taggable.

Mongoid taggable basically just creates an array of tags, but mongoid_search doesn't seem to want to index these tags. I know you've heard about this issue before and for some reason it got closed, but I still have it.

I hav this in my model:

include Mongoid::Taggable
include Mongoid::Search

field :tags, type: Array
search_in :title, :tags, :description

Description and title works fine, but tags it doesn't do anything with.